| *** thorst has joined #openstack-telemetry | 00:03 | |
| *** serverascode has quit IRC | 00:17 | |
| *** athinkingmeat has quit IRC | 00:17 | |
| *** athinkingmeat has joined #openstack-telemetry | 00:17 | |
| *** elemoine_ has quit IRC | 00:18 | |
| *** patrickeast has quit IRC | 00:19 | |
| *** serverascode has joined #openstack-telemetry | 00:19 | |
| *** elemoine_ has joined #openstack-telemetry | 00:20 | |
| *** patrickeast has joined #openstack-telemetry | 00:22 | |
| *** diogogmt has quit IRC | 00:22 | |
| *** zigo has quit IRC | 00:37 | |
| *** zigo has joined #openstack-telemetry | 01:03 | |
| *** chlong has joined #openstack-telemetry | 01:15 | |
| *** marcin1234 has quit IRC | 01:22 | |
| *** r-mibu has quit IRC | 01:57 | |
| *** diogogmt has joined #openstack-telemetry | 02:06 | |
| *** r-mibu has joined #openstack-telemetry | 02:12 | |
| *** rbak has quit IRC | 02:24 | |
| *** dave-mccowan has quit IRC | 02:34 | |
| *** nadya has joined #openstack-telemetry | 02:41 | |
| *** sheel has joined #openstack-telemetry | 02:46 | |
| *** vishwanathj has joined #openstack-telemetry | 02:58 | |
| *** jwcroppe has joined #openstack-telemetry | 03:00 | |
| *** achatterjee has joined #openstack-telemetry | 03:02 | |
| *** ljxiash has joined #openstack-telemetry | 03:09 | |
| *** nadya has quit IRC | 03:11 | |
| *** ljxiash has quit IRC | 03:16 | |
| *** ljxiash has joined #openstack-telemetry | 03:17 | |
| *** ljxiash has quit IRC | 03:21 | |
| *** nadya has joined #openstack-telemetry | 03:40 | |
| *** thorst has quit IRC | 03:51 | |
| *** thorst has joined #openstack-telemetry | 03:51 | |
| *** nadya has quit IRC | 03:53 | |
| *** thorst has quit IRC | 04:00 | |
| *** links has joined #openstack-telemetry | 04:00 | |
| *** vishwanathj has quit IRC | 04:10 | |
| *** vishwanathj has joined #openstack-telemetry | 04:10 | |
| *** thorst has joined #openstack-telemetry | 04:57 | |
| *** thorst has quit IRC | 05:04 | |
| *** yprokule has joined #openstack-telemetry | 05:06 | |
| *** thorst has joined #openstack-telemetry | 06:02 | |
| *** chlong has quit IRC | 06:03 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/aodh: Imported Translations from Zanata https://review.openstack.org/328084 | 06:08 |
|---|---|---|
| *** thorst has quit IRC | 06:10 | |
| *** belmoreira has joined #openstack-telemetry | 06:12 | |
| *** chlong has joined #openstack-telemetry | 06:20 | |
| *** openstackgerrit has quit IRC | 06:32 | |
| *** openstackgerrit has joined #openstack-telemetry | 06:33 | |
| *** chlong has quit IRC | 06:35 | |
| *** pcaruana has joined #openstack-telemetry | 06:40 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ceilometer: Imported Translations from Zanata https://review.openstack.org/328109 | 06:46 |
| *** links has quit IRC | 06:55 | |
| *** hparekh has quit IRC | 06:58 | |
| *** thorst has joined #openstack-telemetry | 07:07 | |
| *** links has joined #openstack-telemetry | 07:10 | |
| *** permalac has joined #openstack-telemetry | 07:15 | |
| *** thorst has quit IRC | 07:15 | |
| *** rcernin has joined #openstack-telemetry | 07:17 | |
| *** jwcroppe has quit IRC | 07:18 | |
| *** sheel has quit IRC | 07:26 | |
| *** sheel has joined #openstack-telemetry | 07:27 | |
| *** tesseract has joined #openstack-telemetry | 07:27 | |
| *** agireud has quit IRC | 07:32 | |
| *** openstackgerrit has quit IRC | 07:33 | |
| *** openstackgerrit has joined #openstack-telemetry | 07:33 | |
| *** agireud has joined #openstack-telemetry | 07:34 | |
| *** vishwanathj has quit IRC | 07:49 | |
| *** vishwanathj has joined #openstack-telemetry | 07:50 | |
| *** shardy has joined #openstack-telemetry | 08:03 | |
| *** thorst has joined #openstack-telemetry | 08:13 | |
| *** jwcroppe has joined #openstack-telemetry | 08:19 | |
| *** thorst has quit IRC | 08:20 | |
| *** jwcroppe has quit IRC | 08:29 | |
| therve | jd__, So as I thought trust integration test didn't work | 08:43 |
| therve | I'll try to see if I can fix it | 08:43 |
| *** yassine__ has joined #openstack-telemetry | 08:47 | |
| *** thorst has joined #openstack-telemetry | 09:18 | |
| *** cdent has joined #openstack-telemetry | 09:24 | |
| *** thorst has quit IRC | 09:25 | |
| *** thorst has joined #openstack-telemetry | 09:37 | |
| jd__ | thanks therve | 09:46 |
| therve | jd__, Do you have an easy way to create an alarm on stuff that doesn't require a VM to be booted | 09:55 |
| jd__ | therve: I'd guess so | 09:55 |
| jd__ | therve: use aodhclient and gnocchiclient? | 09:55 |
| jd__ | you could do it with pifpaf I guess (though there'd be no Keystone) | 09:56 |
| therve | jd__, But what do I need to send? fake meter data? | 09:56 |
| jd__ | therve: yes | 09:56 |
| *** thorst has quit IRC | 09:56 | |
| jd__ | aodh alarm create ... | 09:56 |
| jd__ | gnocchi measures add ... | 09:57 |
| *** thorst has joined #openstack-telemetry | 09:57 | |
| therve | Yeah I just need to figure out what '...' is :) | 09:58 |
| jd__ | I can build you a small example I guess | 09:58 |
| jd__ | give me a few minutes :) | 09:58 |
| *** thorst has quit IRC | 10:01 | |
| jd__ | pip is slow… | 10:03 |
| jd__ | therve: https://gist.github.com/jd/6c53a9877cad50352fff31aecbd29410 something like that | 10:06 |
| jd__ | I realize I need to add aodh-evaluator in pifpaf | 10:06 |
| therve | jd__, Cool thanks | 10:06 |
| jd__ | i'm not sure about the details but that's the big picture | 10:07 |
| jd__ | I'll look into it more deeply after my shower | 10:07 |
| jd__ | I'm interested :D | 10:08 |
| therve | :) | 10:09 |
| therve | Yeah I don't seem to manage to trigger the alarm this way | 10:10 |
| therve | bbl | 10:18 |
| jd__ | therve: yeah I'll dig into that | 10:20 |
| jd__ | that's a good opportunity to find bugs and improve clients in general | 10:20 |
| *** itsme_ has quit IRC | 10:21 | |
| therve | jd__, It'd be cool if an alarm update --state alarm triggered notifications | 10:21 |
| therve | That would simplify things :) | 10:21 |
| jd__ | there's a "blueprint" for that | 10:22 |
| jd__ | to have an entire type of alarm manipulated only by http | 10:22 |
| *** jwcroppe has joined #openstack-telemetry | 10:26 | |
| jd__ | therve: it's ok | 10:27 |
| jd__ | I found the way | 10:27 |
| jd__ | therve: https://gist.github.com/jd/6c53a9877cad50352fff31aecbd29410 updated -> be careful that the timestamps of your measure are around NOW() in UTC! | 10:28 |
| jd__ | and that works | 10:28 |
| jd__ | | state | alarm | | 10:29 |
| jd__ | \o/ | 10:29 |
| *** jwcroppe has quit IRC | 10:31 | |
| openstackgerrit | Sanjana proposed openstack/aodh: Fixing ordering of 'severity' in alarms https://review.openstack.org/328230 | 10:36 |
| *** jmccarthy has joined #openstack-telemetry | 10:39 | |
| *** jmccarthy has left #openstack-telemetry | 10:39 | |
| *** vishwanathj has quit IRC | 10:45 | |
| *** vishwanathj has joined #openstack-telemetry | 10:48 | |
| *** vishwanathj has quit IRC | 10:59 | |
| *** vishwanathj has joined #openstack-telemetry | 11:00 | |
| openstackgerrit | Julien Danjou proposed openstack/gnocchi: tests: fix Gabbi live test to not rely on legacy resource types https://review.openstack.org/327724 | 11:31 |
| *** achatterjee has left #openstack-telemetry | 11:32 | |
| *** cdent has quit IRC | 11:36 | |
| *** jmccarthy has joined #openstack-telemetry | 11:44 | |
| *** jmccarthy has left #openstack-telemetry | 11:44 | |
| *** pcaruana has quit IRC | 11:51 | |
| therve | jd__, OK that sounds good. I still use ceilometer alarms though :) | 11:55 |
| therve | jd__, is meter and metrics the same thing? | 11:55 |
| *** cdent has joined #openstack-telemetry | 12:01 | |
| jd__ | therve: meter is Ceilometer, metric is Gnocchi in general | 12:06 |
| *** pcaruana has joined #openstack-telemetry | 12:07 | |
| therve | jd__, is a meter_name in an alarm a metric name? | 12:07 |
| jd__ | therve: for Gnocchi resources alarm? | 12:10 |
| therve | jd__, Yeah | 12:10 |
| jd__ | yep | 12:10 |
| jd__ | like 'cpu' or whatever | 12:10 |
| jd__ | not sure of the field name but might be meter_name | 12:11 |
| jd__ | metric_name should be more correct but well | 12:11 |
| *** pcaruana has quit IRC | 12:13 | |
| *** pcaruana has joined #openstack-telemetry | 12:13 | |
| therve | jd__, BTW, some unrelated but I'm looking at it | 12:21 |
| therve | jd__, the zaqar notifier is kinda pointless as it uses service credentials | 12:21 |
| therve | If you don't post to user queues I don't see how you can use that | 12:21 |
| openstackgerrit | Thomas Herve proposed openstack/aodh: Fix trust notifier https://review.openstack.org/328268 | 12:33 |
| openstackgerrit | Thomas Herve proposed openstack/ceilometer: Use trusts in Heat integration test https://review.openstack.org/327641 | 12:33 |
| therve | OK let's see | 12:34 |
| *** gordc has joined #openstack-telemetry | 12:37 | |
| *** yprokule has quit IRC | 12:53 | |
| openstackgerrit | Julien Danjou proposed openstack/gnocchi: tests: fix Gabbi live test to not rely on legacy resource types https://review.openstack.org/327724 | 12:54 |
| *** links has quit IRC | 12:54 | |
| *** yprokule has joined #openstack-telemetry | 12:58 | |
| *** peristeri has joined #openstack-telemetry | 13:07 | |
| *** ityaptin has quit IRC | 13:17 | |
| *** KrishR has joined #openstack-telemetry | 13:18 | |
| *** pcaruana has quit IRC | 13:20 | |
| *** jmccarthy has joined #openstack-telemetry | 13:23 | |
| *** jmccarthy has left #openstack-telemetry | 13:24 | |
| *** sheel has quit IRC | 13:25 | |
| *** nicodemus_ has joined #openstack-telemetry | 13:30 | |
| *** dave-mccowan has joined #openstack-telemetry | 13:33 | |
| *** links has joined #openstack-telemetry | 13:36 | |
| *** vishwanathj has quit IRC | 13:39 | |
| *** pcaruana has joined #openstack-telemetry | 13:39 | |
| *** yprokule1 has joined #openstack-telemetry | 13:40 | |
| *** yprokule has quit IRC | 13:41 | |
| openstackgerrit | Julien Danjou proposed openstack/gnocchi: tests: fix Gabbi live test to not rely on legacy resource types https://review.openstack.org/327724 | 13:42 |
| *** diogogmt has quit IRC | 13:54 | |
| *** diogogmt has joined #openstack-telemetry | 13:55 | |
| *** jwcroppe has joined #openstack-telemetry | 13:57 | |
| *** rbak has joined #openstack-telemetry | 14:00 | |
| *** ametts has joined #openstack-telemetry | 14:00 | |
| *** links has quit IRC | 14:01 | |
| *** diogogmt has quit IRC | 14:03 | |
| openstackgerrit | Thomas Herve proposed openstack/aodh: Fix trust notifier https://review.openstack.org/328268 | 14:08 |
| *** ljxiash has joined #openstack-telemetry | 14:16 | |
| *** ljxiash has quit IRC | 14:17 | |
| jd__ | gordc: https://review.openstack.org/#/c/327511/ | 14:22 |
| openstackgerrit | Julien Danjou proposed openstack/gnocchi: tests: fix Gabbi live test to not rely on legacy resource types https://review.openstack.org/327724 | 14:22 |
| gordc | jd__: done | 14:32 |
| gordc | how did they break mitaka too? i thought this was related to some interface change in this cycle? | 14:32 |
| *** thumpba has joined #openstack-telemetry | 14:33 | |
| jd__ | gordc: tempest is branchless | 14:38 |
| gordc | ah right... that fun stuff | 14:40 |
| *** yprokule1 has quit IRC | 14:45 | |
| *** nicodemus_ has quit IRC | 14:51 | |
| *** nicodemus_ has joined #openstack-telemetry | 14:51 | |
| *** cdent has quit IRC | 15:03 | |
| openstackgerrit | Thomas Herve proposed openstack/aodh: Fix trust notifier https://review.openstack.org/328268 | 15:06 |
| john5223 | tempest is branchless? why's that? | 15:06 |
| *** tesseract has quit IRC | 15:09 | |
| *** peristeri has quit IRC | 15:10 | |
| *** pcaruana has quit IRC | 15:13 | |
| *** rcernin has quit IRC | 15:19 | |
| *** cdent has joined #openstack-telemetry | 15:28 | |
| *** jmccarthy has joined #openstack-telemetry | 15:33 | |
| *** jmccarthy has left #openstack-telemetry | 15:33 | |
| *** jkraj has joined #openstack-telemetry | 15:35 | |
| EmilienM | gordc, jd__: I suggest you to pin tempest in your stable/* jobs | 15:36 |
| EmilienM | we do it in Puppet CI and reduced errors | 15:37 |
| EmilienM | tempest has tags, and I think our Puppet stable/mitaka CI is pin on latest tag | 15:37 |
| *** belmoreira has quit IRC | 15:41 | |
| gordc | john5223: i can't remember why? i feel like i've been told once but i forgot. i imagine something related to upgrade | 15:45 |
| gordc | EmilienM: i have no idea how to do that. | 15:46 |
| gordc | something in opnestack-infra? | 15:46 |
| EmilienM | let me loo | 15:46 |
| EmilienM | look | 15:46 |
| gordc | jd__: i added chart to track no ops. it starts peaking near when the number of metrics drops (that's probably when the current workload division logic fails too) | 15:48 |
| EmilienM | gordc: something like https://review.openstack.org/328359 not sure this is the right thing to do though, maybe tempest folks can confirm | 15:52 |
| gordc | oh. so we need to update that every cycle? | 15:53 |
| john5223 | sqlalchemy for ceilometer is stable right? | 15:53 |
| EmilienM | gordc: yeahaybe | 15:53 |
| EmilienM | maybe | 15:53 |
| EmilienM | gordc, jd__: also see https://review.openstack.org/#/c/328359/ | 15:54 |
| gordc | john5223: for storing ceilometer data? it's an option. it's not that performant if you're compute statistics because it has to do it on the fly. | 15:54 |
| gordc | EmilienM: that was the same link | 15:54 |
| gordc | EmilienM: ... it's not 12pm yet. | 15:54 |
| EmilienM | damn | 15:54 |
| gordc | clickbait | 15:55 |
| EmilienM | https://review.openstack.org/328360 | 15:55 |
| *** ametts has quit IRC | 15:55 | |
| EmilienM | gordc: ass/add in commit message lol | 15:55 |
| gordc | lol | 15:56 |
| gordc | EmilienM: can you endorse me for microsoft excel? i'm getting very good at it. :) | 15:56 |
| EmilienM | :) | 15:56 |
| gordc | i'll endorse you for clickbaiting | 15:56 |
| gordc | "false hope" | 15:57 |
| EmilienM | gordc: really not sure about the tempest thing, we should ask them | 15:57 |
| gordc | john5223: you should look at gnocchi (gnocchi.xyz) if your use case is to run stats/alarms against data. if you want to just dump ceilometer data somewhere you can try the existing built in drivers. | 15:58 |
| gordc | EmilienM: i'll add ken'ichi i guess? | 15:58 |
| EmilienM | gordc: https://github.com/openstack/puppet-openstack-integration/commit/76ab00c06f614cfcb771e139b5f06b412d7da4e2 | 15:58 |
| EmilienM | gordc: yeah | 15:58 |
| EmilienM | gordc: see http://docs.openstack.org/releasenotes/tempest/v12.0.0.html | 15:59 |
| EmilienM | I think you're doing good to approve this change | 15:59 |
| gordc | EmilienM: i don't trust you | 15:59 |
| *** peristeri has joined #openstack-telemetry | 16:01 | |
| *** oraclebill has joined #openstack-telemetry | 16:07 | |
| *** ametts has joined #openstack-telemetry | 16:08 | |
| *** jwcroppe has quit IRC | 16:11 | |
| *** jkraj has quit IRC | 16:18 | |
| *** diogogmt has joined #openstack-telemetry | 16:22 | |
| *** vishwanathj has joined #openstack-telemetry | 16:34 | |
| *** yassine__ has quit IRC | 17:00 | |
| *** oraclebill has quit IRC | 17:03 | |
| *** jwcroppe has joined #openstack-telemetry | 17:17 | |
| *** nadya has joined #openstack-telemetry | 17:45 | |
| *** vishwanathj has quit IRC | 17:51 | |
| *** permalac has quit IRC | 17:54 | |
| *** shardy has quit IRC | 17:56 | |
| *** catintheroof has joined #openstack-telemetry | 17:59 | |
| stevelle | gordc: from yesterday, yes any data you have on your testing is welcome. We're going through a process you might be familiar with: trying to get the keys to our lab sorted. | 18:13 |
| *** adreznec has quit IRC | 18:15 | |
| *** adreznec has joined #openstack-telemetry | 18:17 | |
| *** nadya has quit IRC | 18:17 | |
| gordc | stevelle: pm you a link. will publish later on. | 18:20 |
| stevelle | tak | 18:20 |
| gordc | stevelle: i'm not really load testing it, just trying out a scenario with the 3 nodes i have. | 18:20 |
| gordc | but might help you decide where to start from. | 18:21 |
| stevelle | gordc: just out of curiosity do you use supervisord with uwsgi? | 18:23 |
| gordc | stevelle: nope. not sure what that is to be honest. | 18:24 |
| gordc | feel free to send me ideas on what i should be monitoring. | 18:24 |
| gordc | i'm just taking random metrics from the logs (and profile code i added) | 18:25 |
| stevelle | what's the init proces for uwsgi for you, systemd? | 18:25 |
| gordc | not using systemd. one sec. let me grab the command and init file. | 18:26 |
| gordc | stevelle: i'm pretty sure i pip installed uwsgi: http://paste.openstack.org/show/510660/ | 18:31 |
| gordc | that's all i'm doing to start it | 18:31 |
| *** vint_bra has joined #openstack-telemetry | 18:31 | |
| stevelle | and you > uwsgi start gnocchi manually then? | 18:31 |
| gordc | yep | 18:31 |
| stevelle | nice on the .ini that's helpful for comparing against my testing env | 18:31 |
| gordc | it doesn't start like other stuff. i basically installed everything with packstack and manually installed gnocchi from source | 18:31 |
| gordc | stevelle: cool cool. there are a ton of options in uwsgi, i just took whatever sileht had set in gate. | 18:32 |
| stevelle | gordc: Per metric injection max looks high, would be helpful to try to identify that outlier | 18:33 |
| gordc | stevelle: yeah, i'm not exactly sure yet. it's more than likely that i just don't know how to set up ceph (i basically used the helloworld guide) | 18:35 |
| stevelle | I would guess the ceph outliers are still from write locks | 18:35 |
| stevelle | (slide 16) | 18:36 |
| stevelle | err that would be 15 | 18:36 |
| gordc | yeah, that's sorta what i'm thinking. i've added more profile code to see whether it's gnocchi or ceph issue | 18:36 |
| gordc | i should mention i don't have a dedicate journal disk so not sure if that's the reason for oscillations you see in my charts. | 18:37 |
| stevelle | you were generating load on the test hosts? | 18:37 |
| gordc | everything up to slide 28 was done independently. so i tested API posting alone (with no metricd) | 18:37 |
| gordc | and then i posted stuff to backlog and tested metricd alone (with no more api posts) | 18:38 |
| gordc | the ceph nodes should be relatively unused. they're compute nodes but i only have 1 vm on it. | 18:38 |
| stevelle | the asymetry stands out strong in 22 | 18:38 |
| stevelle | also 23 | 18:39 |
| gordc | yeah, i'm trying to figure that out. the last test i did spread out tasks relatively the same. | 18:39 |
| gordc | the low host (host1) is actually my controller node. | 18:40 |
| stevelle | host1 was ceph mon, 2 and 3 were store iirc | 18:40 |
| gordc | right. | 18:41 |
| stevelle | this is all great, we are designing for a different environment model which will be interesting to compare with, if we ever get data | 18:41 |
| gordc | host 1 is also my openstack controller node which has everything except the compute service i guess. | 18:41 |
| gordc | stevelle: that sounds great! | 18:42 |
| *** julim has quit IRC | 18:46 | |
| *** vishwanathj has joined #openstack-telemetry | 18:48 | |
| stevelle | do I recall that aodh is recommended to use sql instead of mongo now? | 18:52 |
| stevelle | given the commit msg I saw a bit ago the mongo store is supposed to go away? | 18:52 |
| *** vishwanathj has quit IRC | 18:53 | |
| gordc | stevelle: correct. | 18:56 |
| *** peristeri has quit IRC | 18:59 | |
| *** vishwanathj has joined #openstack-telemetry | 19:49 | |
| *** vishwanathj has quit IRC | 19:55 | |
| *** ametts has quit IRC | 20:00 | |
| *** julim has joined #openstack-telemetry | 20:06 | |
| *** ametts has joined #openstack-telemetry | 20:15 | |
| *** ametts has quit IRC | 20:30 | |
| *** vishwanathj has joined #openstack-telemetry | 20:50 | |
| *** vishwanathj has quit IRC | 20:56 | |
| *** jwcroppe has quit IRC | 21:08 | |
| *** nicodemus_ has quit IRC | 21:23 | |
| *** pradk has quit IRC | 21:39 | |
| *** vishwanathj has joined #openstack-telemetry | 21:52 | |
| *** vishwanathj has quit IRC | 21:57 | |
| *** dave-mccowan has quit IRC | 22:02 | |
| *** catintheroof has quit IRC | 22:06 | |
| *** KrishR has quit IRC | 22:07 | |
| *** julim has quit IRC | 22:39 | |
| *** vishwanathj has joined #openstack-telemetry | 23:18 | |
| *** vishwanathj has quit IRC | 23:22 | |
| *** gordc has quit IRC | 23:22 | |
| *** vint_bra has quit IRC | 23:32 | |
| *** cdent has quit IRC | 23:33 | |
| *** rwsu has quit IRC | 23:54 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!