*** thorst has joined #openstack-telemetry | 00:25 | |
*** leitan has joined #openstack-telemetry | 00:25 | |
*** thorst has quit IRC | 00:27 | |
*** dixiaoli has joined #openstack-telemetry | 00:51 | |
*** thorst has joined #openstack-telemetry | 00:57 | |
*** daidv has joined #openstack-telemetry | 01:02 | |
*** harlowja has quit IRC | 01:08 | |
*** thorst has quit IRC | 01:16 | |
*** tovin07_ has joined #openstack-telemetry | 01:26 | |
*** dave-mccowan has quit IRC | 01:28 | |
*** dixiaoli has quit IRC | 01:30 | |
*** thorst has joined #openstack-telemetry | 01:31 | |
*** thorst has quit IRC | 01:33 | |
*** Kevin_Zheng has joined #openstack-telemetry | 01:36 | |
*** gongysh has joined #openstack-telemetry | 01:47 | |
*** dave-mccowan has joined #openstack-telemetry | 01:51 | |
*** donghao has joined #openstack-telemetry | 01:52 | |
*** donghao has quit IRC | 01:57 | |
*** leitan has quit IRC | 02:04 | |
*** leitan has joined #openstack-telemetry | 02:05 | |
*** leitan has quit IRC | 02:05 | |
*** leitan has joined #openstack-telemetry | 02:06 | |
*** leitan has quit IRC | 02:10 | |
*** thorst has joined #openstack-telemetry | 02:18 | |
*** thorst has quit IRC | 02:19 | |
*** thorst has joined #openstack-telemetry | 02:29 | |
*** thorst has quit IRC | 02:29 | |
*** liusheng has quit IRC | 02:39 | |
*** vint_bra has joined #openstack-telemetry | 02:40 | |
*** dave-mccowan has quit IRC | 02:42 | |
*** vint_bra has quit IRC | 02:58 | |
*** thorst has joined #openstack-telemetry | 03:00 | |
*** liusheng_ has joined #openstack-telemetry | 03:12 | |
*** thorst has quit IRC | 03:18 | |
*** links has joined #openstack-telemetry | 03:43 | |
*** links has quit IRC | 03:51 | |
*** donghao has joined #openstack-telemetry | 03:54 | |
*** links has joined #openstack-telemetry | 03:55 | |
*** donghao has quit IRC | 03:59 | |
*** thorst has joined #openstack-telemetry | 04:15 | |
*** gongysh has quit IRC | 04:15 | |
*** thorst has quit IRC | 04:20 | |
*** links has quit IRC | 04:24 | |
*** harlowja has joined #openstack-telemetry | 04:33 | |
*** zhangguoqing has joined #openstack-telemetry | 04:40 | |
*** gongysh has joined #openstack-telemetry | 04:53 | |
*** links has joined #openstack-telemetry | 05:06 | |
*** thorst has joined #openstack-telemetry | 05:16 | |
*** thorst has quit IRC | 05:21 | |
*** yprokule has joined #openstack-telemetry | 05:37 | |
*** pcaruana has joined #openstack-telemetry | 05:48 | |
*** harlowja has quit IRC | 05:54 | |
*** liusheng_ has quit IRC | 06:12 | |
*** liusheng_ has joined #openstack-telemetry | 06:13 | |
*** thorst has joined #openstack-telemetry | 06:17 | |
*** rcernin has joined #openstack-telemetry | 06:18 | |
*** thorst has quit IRC | 06:22 | |
*** gongysh has quit IRC | 06:31 | |
*** liusheng_ has quit IRC | 06:34 | |
*** gongysh has joined #openstack-telemetry | 06:43 | |
*** mgagne has quit IRC | 06:53 | |
*** mgagne has joined #openstack-telemetry | 06:56 | |
*** mgagne is now known as Guest24103 | 06:56 | |
*** rcernin has quit IRC | 06:57 | |
*** shardy has joined #openstack-telemetry | 07:06 | |
*** rcernin has joined #openstack-telemetry | 07:12 | |
*** thorst has joined #openstack-telemetry | 07:18 | |
*** thorst has quit IRC | 07:22 | |
*** rcernin has quit IRC | 07:29 | |
*** rcernin has joined #openstack-telemetry | 07:35 | |
*** rcernin has quit IRC | 07:35 | |
*** rcernin has joined #openstack-telemetry | 07:35 | |
*** ioggstream has joined #openstack-telemetry | 07:43 | |
*** gongysh has quit IRC | 07:56 | |
*** thorst has joined #openstack-telemetry | 08:18 | |
openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometermiddleware master: retrieve project id to ignore from keystone https://review.openstack.org/464559 | 08:23 |
---|---|---|
*** thorst has quit IRC | 08:23 | |
*** Drankis has joined #openstack-telemetry | 08:27 | |
*** gongysh has joined #openstack-telemetry | 08:34 | |
*** luisnho223 has joined #openstack-telemetry | 08:41 | |
luisnho223 | hey guys. Anyone already worked with CloudKitty? I am using gnocchi as collector but it does not generate costs reports | 08:43 |
*** shardy has quit IRC | 08:53 | |
sileht | luisnho223, maybe asks on #cloudkitty channel | 08:54 |
*** shardy has joined #openstack-telemetry | 08:56 | |
*** Tamayo has quit IRC | 08:57 | |
*** gongysh has quit IRC | 09:14 | |
*** gongysh has joined #openstack-telemetry | 09:15 | |
*** thorst has joined #openstack-telemetry | 09:19 | |
openstackgerrit | Julien Danjou proposed openstack/gnocchi master: Remove oslo.utils dependency https://review.openstack.org/465008 | 09:36 |
openstackgerrit | Julien Danjou proposed openstack/gnocchi master: Stop using oslo_utils.fnmatch https://review.openstack.org/465006 | 09:36 |
openstackgerrit | Julien Danjou proposed openstack/gnocchi master: Stop using oslo_utils.netutils https://review.openstack.org/465007 | 09:36 |
*** thorst has quit IRC | 09:39 | |
*** links has quit IRC | 09:48 | |
ioggstream | hi@all! | 09:53 |
ioggstream | on rhosp10 the default interval collection policy is 600sec, but the default metric archive-policy is low, with granularity 300 | 09:54 |
ioggstream | this causes all alarms to ignore metrics! | 09:54 |
ioggstream | Shouldn't be default archive-policy.low.granularity and ceilometer/pipeline.yaml:interval aligned ? | 09:55 |
*** tovin07_ has quit IRC | 09:56 | |
*** links has joined #openstack-telemetry | 10:01 | |
*** donghao has joined #openstack-telemetry | 10:01 | |
*** donghao has quit IRC | 10:05 | |
*** faizy has joined #openstack-telemetry | 10:14 | |
*** daidv has quit IRC | 10:30 | |
sileht | ioggstream, agreed the default looks bad | 10:33 |
ioggstream | sileht: yep :( How I could fix that? | 10:33 |
sileht | ioggstream, the 600 is historic, because when Ceilometer was using mongodb, putting less result to a disacter | 10:33 |
sileht | ioggstream, but with Gnocchi it's safer to lower the Ceilometer side | 10:34 |
sileht | ioggstream, you can change the /etc/ceilometer/polling.yaml and put less | 10:34 |
sileht | at least some <= 300 | 10:34 |
ioggstream | sileht: I read this article that sticks with 600 ... | 10:34 |
ioggstream | (looking for it) | 10:34 |
ioggstream | sileht: https://access.redhat.com/solutions/2971771 | 10:35 |
*** thorst has joined #openstack-telemetry | 10:35 | |
ioggstream | (I'm on newton ) | 10:36 |
sileht | ioggstream, this article doesn't care about Aodh, I will propose to change the default | 10:37 |
sileht | ioggstream, we will see what other devs will thing about that | 10:38 |
ioggstream | sileht: that would be great | 10:38 |
ioggstream | sileht: being kb-backed is good | 10:39 |
ioggstream | :) | 10:39 |
ioggstream | sileht: I work on top of openstack and I have to push my claims with the team that deployed it | 10:39 |
ioggstream | (I'm openshift-on-openstack'ing) | 10:39 |
sileht | ioggstream, ok | 10:39 |
*** thorst has quit IRC | 10:40 | |
ioggstream | sileht: feel free to spam me at will ;) | 10:40 |
sileht | ioggstream, We also have people that what to do autoscaling that complains about this default too | 10:40 |
ioggstream | sileht: I imagine ;) | 10:41 |
ioggstream | for now I'll try to make them put 300 | 10:42 |
openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer master: Change default polling interval https://review.openstack.org/465499 | 10:43 |
-openstackstatus- NOTICE: gerrit is being restarted to help stuck git replication issues | 10:55 | |
*** links has quit IRC | 11:05 | |
*** gongysh has quit IRC | 11:18 | |
*** gongysh has joined #openstack-telemetry | 11:18 | |
*** gongysh has quit IRC | 11:19 | |
*** cdent has joined #openstack-telemetry | 11:19 | |
*** gongysh has joined #openstack-telemetry | 11:19 | |
*** gongysh has quit IRC | 11:19 | |
*** gongysh has joined #openstack-telemetry | 11:20 | |
*** gongysh has quit IRC | 11:20 | |
*** links has joined #openstack-telemetry | 11:22 | |
*** iogg has joined #openstack-telemetry | 11:32 | |
*** ioggstream has quit IRC | 11:32 | |
*** Kevin_Zheng has quit IRC | 11:36 | |
openstackgerrit | Julien Danjou proposed openstack/gnocchi master: Fix Carbonara compression with Cradox and LZ4 >= 0.9.2 https://review.openstack.org/465519 | 11:36 |
*** Jack_Iv has joined #openstack-telemetry | 11:46 | |
*** thorst has joined #openstack-telemetry | 11:46 | |
*** gongysh has joined #openstack-telemetry | 11:49 | |
*** donghao has joined #openstack-telemetry | 11:52 | |
*** chlong has quit IRC | 11:57 | |
*** donghao has quit IRC | 11:57 | |
*** gongysh has quit IRC | 11:58 | |
*** gordc has joined #openstack-telemetry | 12:00 | |
*** luisnho223 has quit IRC | 12:00 | |
*** luisnho223 has joined #openstack-telemetry | 12:17 | |
*** vint_bra has joined #openstack-telemetry | 12:46 | |
*** leitan has joined #openstack-telemetry | 12:54 | |
*** fguillot has joined #openstack-telemetry | 12:56 | |
*** zhangguoqing has quit IRC | 12:57 | |
*** lamt has joined #openstack-telemetry | 12:58 | |
openstackgerrit | Merged openstack/ceilometer master: Change default polling interval https://review.openstack.org/465499 | 13:01 |
*** Jack_Iv has quit IRC | 13:12 | |
*** Jack_Iv has joined #openstack-telemetry | 13:12 | |
*** Jack_Iv has quit IRC | 13:13 | |
*** Jack_Iv has joined #openstack-telemetry | 13:13 | |
*** Jack_Iv has quit IRC | 13:13 | |
*** chlong has joined #openstack-telemetry | 13:15 | |
*** lhx_ has joined #openstack-telemetry | 13:27 | |
gordc | jd_: i think there's the same blocking issue on single omap you and akrzos found from metricd pov as well. | 13:35 |
gordc | seems metricd is much better with multiple buckets vs single bucket (unless there's a change we did to ceph recently) | 13:36 |
*** thorst is now known as thorst_afk | 13:36 | |
akrzos | gordc: I suspected there was but i haven't had the time to investigate yet | 13:37 |
akrzos | so thats seems to confirm my suspicion | 13:37 |
akrzos | thats promising to hear | 13:37 |
gordc | akrzos: yeah, can't wait for your next benchmarks :) | 13:38 |
gordc | akrzos: i wanted to followup, but do you have numbers on how many metrics you captured in your test? | 13:38 |
gordc | i think you said 55 metrics/instances? | 13:38 |
akrzos | let me grab that | 13:39 |
akrzos | so the 10k test had 43 metrics/instance | 13:39 |
akrzos | so my test with just booting instances without a network would create an instance and an instance disk resources | 13:40 |
akrzos | the instance had 30 metrics | 13:40 |
akrzos | and the disk had 13 metrics | 13:40 |
luisnho223 | anyone already worked with cloudkitty? Nobody answers me in #cloudkitty channel | 13:40 |
akrzos | when you add a nic into the picture you get 12 more metrics | 13:40 |
akrzos | so instance + disk + nic is 55 metrics | 13:40 |
gordc | akrzos: kk, that's pretty good then. my test was against 20K metrics, seems you're closer to 300K metrics in your test | 13:43 |
akrzos | i was wondering if we could prune that down (The number of metrics) and maybe optimize some to a larger collection rate (greater time definition) if that would be desired by operators | 13:45 |
akrzos | that might get too much into the subjective realm though of what people consider billing vs capacity planning vs performance analysis | 13:46 |
gordc | luisnho223: try the mailing list | 13:46 |
gordc | akrzos: yeah, agreed. i'm kind of interested in storing more than 300K so i'm slightly biased and want to see you store more. :) | 13:47 |
*** lamt has quit IRC | 13:47 | |
akrzos | i'm not saying store less (win by reducing the work) but maybe we don't need certin metrics at a lower interval and maybe we can trade that for other metrics more frequently | 13:48 |
gordc | akrzos: ah, yeah, we could do that. i imagine disk usage might be less important than memory usage | 13:52 |
gordc | no idea how people have it configured in production. | 13:52 |
akrzos | that would be great data to have | 13:52 |
akrzos | what production people are really looking for | 13:52 |
akrzos | i know what i'm looking for so I'm partial to anything system metric wise and a 10s interval :) | 13:53 |
*** lamt has joined #openstack-telemetry | 13:53 | |
*** Drankis has quit IRC | 13:55 | |
*** donghao has joined #openstack-telemetry | 13:55 | |
gordc | akrzos: 10s interval? sure. let's aim for that. | 13:57 |
*** donghao has quit IRC | 14:00 | |
*** luisnho223 has quit IRC | 14:00 | |
gordc | akrzos: oh, one more question. do you have details on your ceph cluster? how many OSDs, nodes, etc... | 14:00 |
akrzos | 12 nodes, 192 osds (16 osd disks, nvme for journal) | 14:01 |
*** iogg has quit IRC | 14:02 | |
*** zhangguoqing has joined #openstack-telemetry | 14:02 | |
*** vint_bra has quit IRC | 14:03 | |
*** iogg has joined #openstack-telemetry | 14:03 | |
*** p01nt3r75 has joined #openstack-telemetry | 14:04 | |
*** vint_bra has joined #openstack-telemetry | 14:06 | |
gordc | akrzos: ... ok. i think it's safe to say i'm going to see any breakage with my 20OSD before you see anything on your end. | 14:07 |
akrzos | yeah i would say so | 14:08 |
akrzos | i have another small cluster this week | 14:08 |
akrzos | i'm gonna stress some more | 14:08 |
akrzos | i'd like togtry and get the latest metricd code on it | 14:08 |
akrzos | s/togtry/to try | 14:08 |
gordc | cool. i have https://review.openstack.org/#/c/464757/ patch up... which gets rid of small objects for omap values... i'm testing it right now to see how many entries i can shove into omap before it keels over | 14:10 |
*** Tamayo has joined #openstack-telemetry | 14:11 | |
*** Guest24103 is now known as mgagne | 14:32 | |
*** mgagne has quit IRC | 14:32 | |
*** mgagne has joined #openstack-telemetry | 14:32 | |
*** iogg has quit IRC | 14:35 | |
*** dave-mccowan has joined #openstack-telemetry | 14:38 | |
*** links has quit IRC | 14:55 | |
*** rcernin has quit IRC | 15:04 | |
*** zhangguoqing has quit IRC | 15:04 | |
*** zhangguoqing has joined #openstack-telemetry | 15:04 | |
lhx_ | jd_, gordc, is there an etherpad discussion for Telemetry during the Boston Summit? | 15:08 |
*** zhangguoqing has quit IRC | 15:09 | |
gordc | lhx_: nope. same as always. if you have requirements, contribute them. if you don't but want to contribute, fix bugs or work on roadmap items :) | 15:11 |
lhx_ | gordc, okay, the summit ended and my session work ended. So I have more time to work on Telemetry | 15:16 |
lhx_ | :) | 15:16 |
gordc | lhx_: good to hear! | 15:20 |
lhx_ | gordc, you may hear about this on Summit | 15:21 |
lhx_ | https://github.com/apolloliu/zcp | 15:21 |
gordc | lhx_: i actually missed that presentation. thanks for reminder | 15:22 |
gordc | lhx_: you send metrics to mongodb and pull it into zabbix>? | 15:22 |
sileht | that's soon overkill to have mongo in the middle :) | 15:23 |
gordc | sileht: :) i didn't want to say it. | 15:23 |
sileht | gordc, we do the same thing during a long time, so I can't really comment | 15:24 |
lhx_ | gordc, it's a simplified edition | 15:24 |
lhx_ | it just pull metrics from ceilometer or mongo | 15:25 |
lhx_ | I have added gnocchi handler to pull metrics to zabbix, but not synchronized to the community | 15:27 |
*** p01nt3r75 has quit IRC | 15:29 | |
lhx_ | sieht, agree, mongo is not the trend | 15:30 |
lhx_ | sileht, | 15:30 |
openstackgerrit | Julien Danjou proposed openstack/gnocchi master: Remove oslo.utils dependency https://review.openstack.org/465008 | 15:30 |
openstackgerrit | Julien Danjou proposed openstack/gnocchi master: Stop using oslo_utils.fnmatch https://review.openstack.org/465006 | 15:30 |
openstackgerrit | Julien Danjou proposed openstack/gnocchi master: Stop using oslo_utils.netutils https://review.openstack.org/465007 | 15:30 |
*** p01nt3r75 has joined #openstack-telemetry | 15:31 | |
gordc | lhx_: you have a dependency on zabbix storage? i would probably just build a zabbix publisher? or even better, just use gnocchi :) | 15:31 |
*** donghao has joined #openstack-telemetry | 15:33 | |
lhx_ | gordc, at least a zabbix server, we use zabbix api to display data | 15:33 |
lhx_ | I guess it has no dependency | 15:34 |
*** yprokule has quit IRC | 15:35 | |
lhx_ | gordc, use gnocchi as zabbix storage? | 15:36 |
jd_ | that'd be cool | 15:37 |
*** donghao has quit IRC | 15:38 | |
*** donghao has joined #openstack-telemetry | 15:39 | |
lhx_ | jd_, it can also integrate with grafana. | 15:40 |
lhx_ | but the project seems have no much users | 15:40 |
openstackgerrit | Julien Danjou proposed openstack/gnocchi master: Fix Carbonara compression with Cradox and LZ4 >= 0.9.2 https://review.openstack.org/465519 | 15:41 |
jd_ | lhx_: well you can have Gnocchi and Grafana so… :) | 15:41 |
lhx_ | jd_, haha, that's was written for the Liberty Ceilometer. but it's more scalability. Gnocchi and Grafana is a good direction. | 15:48 |
jd_ | lhx_: time to upgrade :p | 15:48 |
lhx_ | jd_, User is driving force, I have to see if there any user for it. :) | 15:49 |
jd_ | make sense :) | 15:50 |
* lhx_ nod | 15:51 | |
*** pradk has quit IRC | 16:03 | |
*** pradk has joined #openstack-telemetry | 16:10 | |
*** pcaruana has quit IRC | 16:11 | |
*** p01nt3r75 has quit IRC | 16:20 | |
*** harlowja has joined #openstack-telemetry | 16:33 | |
*** lhx_ has quit IRC | 16:54 | |
openstackgerrit | Merged openstack/python-pankoclient master: add .gitignore file https://review.openstack.org/465158 | 17:00 |
*** donghao has quit IRC | 17:04 | |
*** donghao has joined #openstack-telemetry | 17:04 | |
*** donghao has quit IRC | 17:12 | |
*** harlowja has quit IRC | 17:26 | |
*** shardy has quit IRC | 17:32 | |
*** leitan has quit IRC | 18:42 | |
*** catintheroof has joined #openstack-telemetry | 18:59 | |
catintheroof | jd_: im having issues doing pyhton setup.py install with stable/3.0 -> https://pastebin.com/sdkWSneq | 19:05 |
catintheroof | jd_: thoughts ? | 19:05 |
*** donghao has joined #openstack-telemetry | 19:10 | |
*** donghao has quit IRC | 19:15 | |
*** pradk has quit IRC | 19:28 | |
jd_ | catintheroof: always use pip: pip install . | 19:29 |
jd_ | catintheroof: RTFM ;) | 19:29 |
*** harlowja has joined #openstack-telemetry | 19:39 | |
openstackgerrit | Julien Danjou proposed openstack/gnocchi master: Remove oslo.utils dependency https://review.openstack.org/465008 | 19:43 |
*** pradk has joined #openstack-telemetry | 19:47 | |
*** harlowja has quit IRC | 19:53 | |
*** harlowja has joined #openstack-telemetry | 19:57 | |
openstackgerrit | gordon chung proposed openstack/python-pankoclient master: remove unit tests against common code https://review.openstack.org/465144 | 19:59 |
openstackgerrit | gordon chung proposed openstack/python-pankoclient master: switch to use non-legacy SessionClient https://review.openstack.org/465157 | 19:59 |
openstackgerrit | gordon chung proposed openstack/python-pankoclient master: use extras https://review.openstack.org/465141 | 19:59 |
openstackgerrit | gordon chung proposed openstack/python-pankoclient master: move shell out of osc https://review.openstack.org/465725 | 19:59 |
*** harlowja has quit IRC | 20:00 | |
*** vint_bra has quit IRC | 20:01 | |
*** cdent has quit IRC | 20:05 | |
*** vint_bra has joined #openstack-telemetry | 20:08 | |
*** vint_bra has quit IRC | 20:22 | |
*** vint_bra has joined #openstack-telemetry | 20:26 | |
*** pradk has quit IRC | 20:27 | |
*** fguillot has quit IRC | 20:27 | |
*** pradk has joined #openstack-telemetry | 20:28 | |
*** lamt has quit IRC | 20:33 | |
*** lamt has joined #openstack-telemetry | 20:35 | |
openstackgerrit | gordon chung proposed openstack/python-pankoclient master: move shell out of osc https://review.openstack.org/465725 | 20:36 |
openstackgerrit | gordon chung proposed openstack/python-pankoclient master: add panko shell https://review.openstack.org/465736 | 20:37 |
*** chlong has quit IRC | 20:52 | |
*** catintheroof has quit IRC | 21:01 | |
*** thorst_afk has quit IRC | 21:03 | |
*** gordc has quit IRC | 21:08 | |
*** donghao has joined #openstack-telemetry | 21:13 | |
*** donghao has quit IRC | 21:17 | |
*** agatea_ has joined #openstack-telemetry | 21:32 | |
openstackgerrit | Julien Danjou proposed openstack/gnocchi master: redis: fix CLIENT_LIST_ARGS parsing https://review.openstack.org/465748 | 21:32 |
*** agatea_ has quit IRC | 21:44 | |
*** aagate has joined #openstack-telemetry | 21:52 | |
*** thorst_afk has joined #openstack-telemetry | 22:00 | |
*** vint_bra has quit IRC | 22:00 | |
*** harlowja has joined #openstack-telemetry | 22:02 | |
*** aagate has quit IRC | 22:06 | |
*** aagate has joined #openstack-telemetry | 22:08 | |
*** aagate has quit IRC | 22:13 | |
*** aagate has joined #openstack-telemetry | 22:13 | |
*** aagate_ has joined #openstack-telemetry | 22:14 | |
*** aagate_ has quit IRC | 22:14 | |
*** aagate has quit IRC | 22:14 | |
*** aagate has joined #openstack-telemetry | 22:14 | |
*** aagate has quit IRC | 22:16 | |
*** aagate has joined #openstack-telemetry | 22:16 | |
*** rwsu has quit IRC | 22:17 | |
*** harlowja has quit IRC | 22:18 | |
*** aagate has quit IRC | 22:18 | |
*** thorst_afk has quit IRC | 22:20 | |
*** aagate has joined #openstack-telemetry | 22:27 | |
*** leitan has joined #openstack-telemetry | 22:28 | |
*** pradk has quit IRC | 22:51 | |
*** lamt has quit IRC | 22:57 | |
*** rwsu has joined #openstack-telemetry | 23:10 | |
*** thorst_afk has joined #openstack-telemetry | 23:20 | |
*** thorst_afk has quit IRC | 23:41 | |
*** leitan has quit IRC | 23:43 | |
*** vint_bra has joined #openstack-telemetry | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!