Thursday, 2019-06-06

*** spsurya has joined #openstack-freezer01:01
openstackgerritMerged openstack/freezer-api master: Add python3.7 unit test job in tox.ini  https://review.opendev.org/66326401:32
*** goldyfruit has joined #openstack-freezer01:50
*** whoami-rajat has joined #openstack-freezer02:07
*** ivve has joined #openstack-freezer10:27
goldyfruitivve, all good ?12:08
ivvegoldyfruit: yeah thanks, got your message last time13:14
ivvejust havn't had time to look at it yet13:14
ivvereno that is13:14
goldyfruitno problem13:14
ivvelooking a lot on monasca and how things are supposed to work13:15
goldyfruithttps://docs.openstack.org/reno/latest/13:15
ivvewhich is the last service i will look into for a while, need a break :P13:15
goldyfruitYeah Monasca is a big piece13:16
ivvenot more complex than magnum i hope13:16
ivvethat was a big piece13:16
goldyfruitMagnum is pretty simple13:16
ivvewell yea i guess the end results are different13:17
ivveend result from magnum is very complex while monasca end result is very simple13:17
ivvelike.. metrics? :)13:17
ivvelogs13:17
goldyfruityeah13:17
ivveon the other hand a working k8s cluster13:17
ivveis a beast in itself13:17
ivvewell with octavia, cinder and keystone implemented of course13:18
goldyfruitBut magnum doesn't really have to deal with the cluster after the initial deployment13:18
goldyfruitscale up/down13:18
ivvescalig13:18
ivvescaling*13:18
ivveand healthchecks i guess13:18
goldyfruitWe are using it since 1 year, no big issue13:19
ivvejust trying to figure out how to use monasca from a user perspective13:19
goldyfruitStein cycle helped a lot for the time spawning13:19
ivveit did13:19
ivvedeployed with kolla?13:19
goldyfruityeah13:19
ivvei had an idea13:19
ivvewhich i thought was great, and that is to have all fragments in a mount13:19
goldyfruitWe did some investigation on Monasca13:20
goldyfruitdeploy it13:20
ivvewith the possibility to edit them and try new stuff easier13:20
goldyfruitbut to complex to what it gave to us13:20
ivvereally13:20
ivvewhat is your take on promethus?13:21
goldyfruitMagnum deploys it with Kubernetes13:21
goldyfruitAnd we are using it to monitor our platforms13:21
ivveyea i mean like for openstack13:21
ivveand if possible to gather metrics on instances13:21
ivveceilometer and gnocchi is just very slow13:21
goldyfruitivve, we are using ceilometer gnocchi13:22
ivveanything using influx or promethus is fast enough13:22
ivvei guess you could backend gnocchi to influx13:22
goldyfruitNop, Ceph13:22
ivvecurrently i have tested ceph13:22
goldyfruitwe had trouble because of the amount of data (iops)13:22
ivveand that was insanely slow (to get graphs to grafana)13:23
goldyfruitSSD pool ^^13:23
ivvei guess ssd/nvme is a must?13:23
goldyfruitFirst it was on harddrive then Gnocchi was too slow to process the metrics13:23
ivvealso gnocchi queries are very poorly documented13:23
goldyfruitSSD solved the issue13:23
ivvei have no clue how to query something in grafana13:23
ivvegnocchi.xyz explains everything extremly vaguely13:24
ivveimho13:24
goldyfruitYeah13:24
ivvei had some older queries that worked in rocky13:24
ivveupgraded13:24
ivveonly memory worked for instances13:24
ivveso i lost all metrics for cpu, network and storage13:25
ivvethat sucked13:25
goldyfruitarf13:25
ivveand haven't figured it out yet13:25
ivvedue to docs.. :(13:25
goldyfruitAsk to Julien13:25
goldyfruitJulien Danjour13:25
goldyfruitDanjou*13:25
goldyfruitPretty sure there is an IRC chanel13:25
goldyfruitI've to work :D13:27
goldyfruitI'm still there if you need help with Reno13:27
ivvebut the openstack node exporters don't gather metrics from compute workload?13:27
ivveah alright, thanks for the talk tho :)13:27
goldyfruitYou will need a bunch of exporter13:28
goldyfruitexporters*13:28
goldyfruitacross controller, compute, storage, etc...13:28
ivvethere was this openstack exporter from linaro?13:28
goldyfruitThis collects only the resources like instances, images, volumes, etc...13:29
ivveah13:29
ivvenot utilization13:29
ivvewhich is what ceilometer gets13:29
goldyfruitIt's very useful for capacity planing13:29
goldyfruitIf you really needs metrics then I guess Monasca will be for you13:29
goldyfruitCeilometer/Gnocchi gives the basics (cpu, ram, disk, network, iops)13:30
ivveyes13:30
ivvei wanna give gnocchi a chance13:30
goldyfruitSince our Gnocchi is on SSD pool in our Ceph we don't have any issue with it!13:31
*** whoami-rajat has quit IRC13:47
*** goldyfruit has quit IRC13:51
*** goldyfruit has joined #openstack-freezer13:51
*** whoami-rajat has joined #openstack-freezer13:57
*** goldyfruit_ has joined #openstack-freezer14:42
*** goldyfruit has quit IRC14:42
*** goldyfruit_ has quit IRC14:50
*** goldyfruit has joined #openstack-freezer14:50
*** whoami-rajat has quit IRC16:07
*** whoami-rajat has joined #openstack-freezer16:12
*** spsurya has quit IRC17:40
*** goldyfruit has quit IRC21:17
*** goldyfruit has joined #openstack-freezer21:18
ivvegoldyfruit: seems the problem is ceilometer and not gnocchi.. doesn't seem to be able to poll cpu_util21:22
ivveenabled all pollsters and full pipeline but tons of stuff is missing and getting weird errors about volumes missing21:23
ivvewierd21:23
goldyfruitYour gnocchi policies are ok21:24
*** goldyfruit has quit IRC21:26
*** goldyfruit has joined #openstack-freezer21:27
*** whoami-rajat has quit IRC21:27
*** goldyfruit_ has joined #openstack-freezer21:29
*** goldyfruit has quit IRC21:29
goldyfruit_ivve, what about your ceilometer pipeline ?21:30
*** goldyfruit_ has quit IRC21:52
*** goldyfruit has joined #openstack-freezer21:58
*** goldyfruit has quit IRC22:19
*** goldyfruit has joined #openstack-freezer22:38
*** goldyfruit has quit IRC23:02
*** goldyfruit has joined #openstack-freezer23:34

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!