Tuesday, 2015-07-28

*** thorst has quit IRC00:04
*** vishwanathj has quit IRC00:05
*** pauldix has quit IRC00:13
*** ddaskal has quit IRC00:23
*** rbak has joined #openstack-ceilometer00:36
*** ildikov has joined #openstack-ceilometer00:46
*** openstackgerrit has quit IRC00:46
*** openstackgerrit has joined #openstack-ceilometer00:47
*** _cjones_ has quit IRC00:50
*** rbak has quit IRC00:53
*** rbak has joined #openstack-ceilometer00:55
*** ankita_w_ has quit IRC01:20
*** rbak has quit IRC01:24
*** rbak has joined #openstack-ceilometer01:24
*** jwcroppe has quit IRC01:30
*** jwcroppe has joined #openstack-ceilometer01:30
*** jwcroppe has quit IRC01:35
*** rbak has quit IRC01:43
*** lexholden has quit IRC01:51
*** changbl has quit IRC02:37
*** chmouel_ has joined #openstack-ceilometer03:03
*** chmouel- has joined #openstack-ceilometer03:04
*** chmouel| has joined #openstack-ceilometer03:05
*** chmouel^ has joined #openstack-ceilometer03:05
*** chmouel^ has quit IRC03:10
*** chmouel- has quit IRC03:10
*** chmouel_ has quit IRC03:10
*** chmouel| has quit IRC03:10
*** chmouel has quit IRC03:10
*** chmouel has joined #openstack-ceilometer03:11
*** Kennan2 has quit IRC03:20
*** Kennan has joined #openstack-ceilometer03:20
*** jwcroppe has joined #openstack-ceilometer03:30
*** julim has quit IRC03:46
*** htruta_ has quit IRC03:50
*** jwcroppe has quit IRC04:02
*** jwcroppe has joined #openstack-ceilometer04:03
*** jwcroppe_ has joined #openstack-ceilometer04:06
*** jwcroppe has quit IRC04:08
*** yprokule has joined #openstack-ceilometer04:12
*** jwcroppe_ has quit IRC04:16
*** jwcroppe has joined #openstack-ceilometer04:17
*** jwcroppe has quit IRC04:22
*** ankita_wagh has joined #openstack-ceilometer04:54
*** jwcroppe has joined #openstack-ceilometer04:56
*** jwcroppe has quit IRC04:58
*** jwcroppe has joined #openstack-ceilometer04:58
*** jwcroppe_ has joined #openstack-ceilometer05:01
*** jwcroppe has quit IRC05:03
*** flwang1 has quit IRC05:05
*** ankita_wagh has quit IRC05:12
*** ankita_wagh has joined #openstack-ceilometer05:13
*** ankita_wagh has quit IRC05:17
*** ankita_wagh has joined #openstack-ceilometer05:29
*** _nadya_ has joined #openstack-ceilometer06:16
*** deepthi has joined #openstack-ceilometer06:18
*** _nadya_ has quit IRC06:20
*** belmoreira has joined #openstack-ceilometer06:25
*** vishwanathj has joined #openstack-ceilometer06:28
*** liusheng has quit IRC06:36
*** liusheng has joined #openstack-ceilometer06:37
*** afazekas has joined #openstack-ceilometer06:44
-openstackstatus- NOTICE: zuul is stuck and about to undergo an emergency restart, please be patient as job results may take a long time06:44
*** ChanServ changes topic to "zuul is stuck and about to undergo an emergency restart, please be patient as job results may take a long time"06:44
*** _nadya_ has joined #openstack-ceilometer06:47
*** jwcroppe_ has quit IRC06:48
*** _nadya_ has quit IRC06:53
*** _nadya_ has joined #openstack-ceilometer06:53
openstackgerritLan Qi Song proposed openstack/ceilometer: Add keystone V3 support for service credentials  https://review.openstack.org/20633306:58
*** _nadya_ has quit IRC06:58
*** cdent has joined #openstack-ceilometer07:02
*** ankita_wagh has quit IRC07:09
*** ankita_wagh has joined #openstack-ceilometer07:09
*** ankita_wagh has quit IRC07:14
*** guy_rodrigue has joined #openstack-ceilometer07:24
*** safchain has joined #openstack-ceilometer07:25
*** lan has joined #openstack-ceilometer07:30
lansileht, ping07:32
silehtlan, hi07:32
lansileht, for this patch: https://review.openstack.org/#/c/206333/   you mean all the alarm related change should go in aodh now ?07:33
silehtlan, yes07:33
lansileht,  what should I do if I want to fix this issue in stable/kilo branch ?07:34
cdentjd__: is this your older brother or uncle or something? http://openstackreactions.enovance.com/2015/07/starting-to-write-a-long-spec-for-an-openstack-project/07:36
cdentsame eyes07:36
lansileht,  may I propose a similar patch only in ceilometer  stable/kilo branch ?07:36
silehtlan, good question, If you want a kilo backport you must do it in aodh then ceilometer/master then ceilometer/kilo07:37
cdentthat seems a bit painful :)07:37
silehtyeah but we don't want to have fix done in ceilometer but not in aodh07:38
* cdent nods07:38
lanok, will do it,  thanks : )07:43
openstackgerritLan Qi Song proposed openstack/aodh: Add keystone V3 support for service credentials  https://review.openstack.org/20634507:56
*** ChanServ changes topic to "OpenStack Telemetry (Ceilometer) | https://wiki.openstack.org/wiki/Ceilometer"08:01
-openstackstatus- NOTICE: zuul has been restarted and queues restored. It may take some time to work through the backlog.08:01
*** jwcroppe has joined #openstack-ceilometer08:02
*** guy_rodrigue has left #openstack-ceilometer08:08
*** vishwanathj has quit IRC08:27
*** vishwanathj has joined #openstack-ceilometer08:28
*** flwang1 has joined #openstack-ceilometer08:29
*** alexpilotti has joined #openstack-ceilometer08:33
*** flwang1 has quit IRC08:33
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: storage: deprecates mongodb_replica_set option  https://review.openstack.org/20607308:34
openstackgerritJulien Danjou proposed openstack/gnocchi: Disable global constraints in devstack  https://review.openstack.org/20546908:38
openstackgerritJulien Danjou proposed openstack/gnocchi: opts: use new min= in IntOpt from oslo.config  https://review.openstack.org/20513208:38
openstackgerritJulien Danjou proposed openstack/gnocchi: Unify requirements  https://review.openstack.org/20543708:38
*** vishwanathj has quit IRC08:39
*** yassine__ has joined #openstack-ceilometer08:40
openstackgerritIlya Tyaptin proposed openstack/ceilometer: [MongoDB] Use a aggregate pipeline in statistics  https://review.openstack.org/17234008:41
*** vishwanathj has joined #openstack-ceilometer08:53
*** jwcroppe has quit IRC09:02
*** vishwanathj has quit IRC09:10
*** boris-42 has quit IRC09:10
*** vishwanathj has joined #openstack-ceilometer09:12
*** Ala has joined #openstack-ceilometer09:13
*** jwcroppe has joined #openstack-ceilometer09:16
*** jwcroppe has quit IRC09:16
openstackgerritMerged openstack/aodh: Add keystone V3 support for service credentials  https://review.openstack.org/20634509:20
openstackgerritMerged openstack/aodh: Add basic gate functional testing jobs for aodh  https://review.openstack.org/20561609:20
*** _nadya_ has joined #openstack-ceilometer09:23
*** exploreshaifali has joined #openstack-ceilometer09:24
silehtcdent, in gabbi the start/stop fixture are ran for each yaml files, not each tests, right ?09:30
cdentthat's correct09:31
silehtthx09:31
silehtcdent, I will add some live tests on gnocchi that inject ceilometer sample in a fixture, and checks them on gnocchi like you done for sample/event in ceilometer09:32
cdentcool09:32
cdentI think there's quite a lot we can do with gabbi in the functional tests if we experiment09:33
cdentare you aware of gabbi-run (the command line runner)?09:33
cdentyou can use it in shell pipelines09:33
cdentwhich might make sense for some tests09:33
silehtHum looks very cool to help me to write the yaml I want09:35
cdentyeah, that too09:37
*** jwcroppe has joined #openstack-ceilometer09:38
silehtI see another use case I have that can be fixed with this09:38
silehtI have thought to write the autoscaling use-cases with gabbi, ie:09:39
sileht* use Heat-API with gabbi to create a stack09:39
sileht* check vm is created in nova09:39
sileht* check alarm are created in aodh09:40
sileht* check gnocchi received data09:40
cdentyup, with the poll functionality that ought to be eminently do-able09:40
silehtI wondered how with gabbi I can query mutiple API, the runner allow that :)09:41
cdentyou would need to express the hosts in the urls in the yaml file, rather than passing in the host:port on the command line09:41
cdentyou could use environment variables09:42
cdenturl: $ENVIRON['nova_base']/servers/foo/details09:42
cdentor something like that09:42
*** jwcroppe has quit IRC09:42
cdentor get everyone on port with everyone on port 80 on the same host :)09:42
silehtcdent, does the host in url works ?09:43
cdentyes09:43
silehtcool09:43
cdentand you can intermix09:43
cdenturl: / and url: http://somehost/ can be in the same file09:43
silehtcool, another question I have for gabbi, is it possible to post a external file ?09:44
* sileht don't want to put the heat template in the yaml file09:44
cdentyeah09:44
cdentdata can take a file name09:44
cdenthttp://gabbi.readthedocs.org/en/latest/format.html#data09:45
cdentdata: <@filename09:45
silehtawesome09:45
cdentmake sure you set the content-type header09:45
* sileht feels ready to write the heat+ceilo+gnocchi+aodh tests09:46
openstackgerritMerged openstack/gnocchi: Disable global constraints in devstack  https://review.openstack.org/20546909:48
openstackgerritMerged openstack/gnocchi: opts: use new min= in IntOpt from oslo.config  https://review.openstack.org/20513209:48
openstackgerritMerged openstack/gnocchi: Unify requirements  https://review.openstack.org/20543709:48
cdentthat will be very cool sileht09:49
cdentan _actual_ integration test09:49
cdentsileht: don't forget that if you're using gabbi-run you don't get fixtures, but if you're in a shell pipeline anyway, you probaby don't want them...09:50
silehtyes09:51
cdentcool09:51
cdentgate be slow10:02
cdentis this an uintended consequence of the big tent?10:02
*** lexholden has joined #openstack-ceilometer10:03
*** jwcroppe has joined #openstack-ceilometer10:04
*** _nadya_ has quit IRC10:12
openstackgerritliusheng proposed openstack/aodh: Add alembic support for aodh  https://review.openstack.org/20645910:12
*** _nadya_ has joined #openstack-ceilometer10:13
*** jwcroppe has quit IRC10:19
openstackgerritJulien Danjou proposed openstack/aodh: tests.api: remove unused argument/config option  https://review.openstack.org/20596910:36
openstackgerritJulien Danjou proposed openstack/aodh: mongodb: stop using global config object  https://review.openstack.org/20556310:36
openstackgerritJulien Danjou proposed openstack/aodh: tests.db: simplify connection handling  https://review.openstack.org/20556210:36
openstackgerritJulien Danjou proposed openstack/aodh: api: remove global conf and local pecan config  https://review.openstack.org/20597110:36
openstackgerritJulien Danjou proposed openstack/aodh: storage: always use get_connection_from_config()  https://review.openstack.org/20556110:36
openstackgerritJulien Danjou proposed openstack/aodh: api: remove force_canonical option  https://review.openstack.org/20597010:36
openstackgerritJulien Danjou proposed openstack/aodh: api: stop using a global Enforcer object  https://review.openstack.org/20557210:36
openstackgerritJulien Danjou proposed openstack/aodh: evaluator: remove global conf usage from threshold evaluator  https://review.openstack.org/20597310:36
openstackgerritJulien Danjou proposed openstack/aodh: api.hooks: stop using global conf object  https://review.openstack.org/20557110:36
openstackgerritJulien Danjou proposed openstack/aodh: rpc: remove global conf usage from notifier  https://review.openstack.org/20597210:36
openstackgerritJulien Danjou proposed openstack/aodh: mongodb: stop relying on global conf object in utils  https://review.openstack.org/20597510:36
openstackgerritJulien Danjou proposed openstack/aodh: mongodb: replace custom retry code by retrying  https://review.openstack.org/20597410:36
openstackgerritJulien Danjou proposed openstack/aodh: api: fix alarm group declaration  https://review.openstack.org/20647010:36
openstackgerritJulien Danjou proposed openstack/aodh: gnocchi: stop using global conf object from ks client  https://review.openstack.org/20647110:36
*** deepthi has quit IRC10:37
*** p01s0n has joined #openstack-ceilometer10:42
p01s0ncan ceilometer monitor custom application parameters and trigger heat for autoscaling10:43
p01s0nfor eg: monitor number of active httpd children10:44
*** eglynn has joined #openstack-ceilometer10:52
cdentp01s0n: you'd need to write a plugin to gather those numbers, but once you had the numbers you could alarm on them11:02
cdentfor that use case you'd probably want a Pollster plugin11:03
cdenti suppose another way to do it would be a custom snmp oid11:07
silehtor write a write that send sample via ceilometer or gnocchi-api11:08
cdentand that too11:08
cdentdepends on how you want to control it11:09
* cdent remembers a world of custom snmp with some fondness11:09
silehtcdent, it seems that gabbit_live tests are not ran in gate :(11:10
cdent which project?11:11
silehtgnocchi11:11
silehtthe GNOCCHI_SERVICE_URL is set in the hook, doesn't pass through tox11:11
* cdent looks at tox.ini11:11
silehtforget my bad11:11
* sileht have run gabbi target instead of the gate target ...11:12
cdentyeah, the gate target has the required passenv11:12
ityaptincdent, sileht: HI! One question to Gnocchi Tests Masters :)11:20
ityaptinor it's an Gnocchi devstack plugin issue11:20
cdentwhat's up?11:20
ityaptindo you know what Gnocchi doesn't install test requirements to the devstack?11:21
silehtityaptin, devstack never install test requirements11:21
silehtityaptin, if an optional dep is needed for gating, you need to install it manually in the devstack plugin11:22
ityaptinsileht, aha, ok. Does gate tests should to install test requirements?11:22
cdentityaptin: only the specific one or ones that you are testing11:23
cdentnot all of them11:23
*** _nadya_ has quit IRC11:23
silehtityaptin, example for pymongo and ceilometer:11:23
silehthttps://github.com/openstack/ceilometer/blob/master/devstack/plugin.sh#L13811:23
silehtor ceilometer+vmware test: https://github.com/openstack/ceilometer/blob/master/devstack/plugin.sh#L15811:24
*** _nadya_ has joined #openstack-ceilometer11:24
ityaptincdent, sileht: Thanks! I'll look into it.11:24
*** rbak has joined #openstack-ceilometer11:25
ityaptinSo, in the light of the knowledge revealed to me, I have a question about influxdb driver patch.11:28
ityaptinNow gate running fails caused by missing influxdb library when we collect opts.11:28
*** _nadya_ has quit IRC11:29
*** rbak has quit IRC11:29
cdentityaptin: if influx stuff is not or cannot be installed, then tests that require it need to skip11:29
ityaptinI see two ways: keep opts registering  as is or move all opts relative to different storages into base storage module.11:29
*** thorst has joined #openstack-ceilometer11:29
cdentoh I see what you're saying11:30
* cdent looks at jd__ and sileht 11:30
cdentthis is beyond my ken11:30
* sileht takes a look to the review11:31
ityaptinsileht: devstack logs of failed job: http://logs.openstack.org/07/165407/18/check/gate-gnocchi-dsvm-functional-file-mysql/77ac35b/logs/devstacklog.txt.gz11:32
*** tshtilma has joined #openstack-ceilometer11:32
silehtityaptin, I see two ways:11:32
sileht* move options in influxdb_opts.py (stevedore will fail to load the driver, but list_opts will works)11:32
sileht* add try/except ImportError around import influx and reraise the ImportError in __init__ of the driver if any11:33
sileht  (the file will load, but the driver will fail to load as expected))11:34
silehtityaptin, make sense ?11:34
ityaptinsileht, yes. The first way looks more preferred to me.11:35
openstackgerritLiangHuifei proposed openstack/ceilometer: Romove redundant comma The comma in def test_direct_publisher(self, ) is redundant, so we should remove it.  https://review.openstack.org/20543511:36
*** jaosorior has joined #openstack-ceilometer11:37
openstackgerritLiangHuifei proposed openstack/ceilometer: Remove redundant comma The comma in def test_direct_publisher(self, ) is redundant, so we should remove it.  https://review.openstack.org/20543511:37
ityaptinsileht, what do you think about different config groups for different drivers?11:39
ityaptinsileht: like this http://paste.openstack.org/show/406048/11:39
ityaptinsileht: when we may register configs into storage/__init__.py, for example.11:40
silehtityaptin, I prefer the group11:40
ityaptinsileht: Sorry for fact what i'm slowpoke, but for better understanding, are you prefer one [storage] group or you prefer different group for storages or other variant?11:46
openstackgerritLiangHuifei proposed openstack/ceilometer: Remove redundant comma  https://review.openstack.org/20543511:46
ityaptin:-)11:46
silehtityaptin, one group per storage driver11:46
ityaptinsileht, aha, ok.11:47
*** jwcroppe has joined #openstack-ceilometer11:51
jd__sileht: can you check https://review.openstack.org/#/c/195097/ which is getting old?11:55
openstackgerritIlya Tyaptin proposed openstack/gnocchi: InfluxDB storage driver  https://review.openstack.org/16540711:58
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: gate: fixup gabbi live tests  https://review.openstack.org/20651012:01
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Add tests to not break ceilometer dispatcher  https://review.openstack.org/20651112:01
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: DONT MERGE: check live tests run in gate  https://review.openstack.org/20651212:01
*** p01s0n has quit IRC12:08
*** rbak has joined #openstack-ceilometer12:08
*** gordc has joined #openstack-ceilometer12:11
*** _nadya_ has joined #openstack-ceilometer12:14
*** jwcroppe has quit IRC12:19
*** pauldix has joined #openstack-ceilometer12:20
*** jwcroppe has joined #openstack-ceilometer12:20
openstackgerritMerged openstack/gnocchi: carbonara: stop storing full res timeserie in archives  https://review.openstack.org/19509712:22
*** jruano has joined #openstack-ceilometer12:23
*** edmondsw has joined #openstack-ceilometer12:33
gordcsileht: can we call the declarative gnocchi work complete?12:38
silehtgordc, yes12:39
gordcsileht: cool cool :)12:39
gordccdent: how about pollsters-no-transform? you think we can get the config option patch today/tomorrow... if not i'll push bp to liberty-3... or we can mark it complete and add config opt as bug12:42
cdentgordc: it's done, i added you to the review12:43
gordccdent: nm then.12:43
*** eglynn has quit IRC12:48
*** changbl has joined #openstack-ceilometer12:50
openstackgerritMerged openstack/ceilometer: Remove redundant comma  https://review.openstack.org/20543512:51
*** julim has joined #openstack-ceilometer12:55
*** changbl has quit IRC12:55
*** gordc is now known as gordc_meeting12:56
*** clduser has joined #openstack-ceilometer12:57
*** pauldix has quit IRC12:58
*** yprokule has quit IRC12:58
*** lexholden has quit IRC13:02
*** afazekas has quit IRC13:02
*** yprokule has joined #openstack-ceilometer13:02
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: DONT MERGE: check live tests run in gate  https://review.openstack.org/20651213:08
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: gate: fixup gabbi live tests  https://review.openstack.org/20651013:08
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Add tests to not break ceilometer dispatcher  https://review.openstack.org/20651113:08
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: DONT MERGE: check live tests run in gate  https://review.openstack.org/20651213:11
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Add tests to not break ceilometer dispatcher  https://review.openstack.org/20651113:11
*** edmondsw has quit IRC13:14
*** prad has joined #openstack-ceilometer13:15
*** tshtilma has quit IRC13:15
*** gordc_ghost has joined #openstack-ceilometer13:16
*** lexholden has joined #openstack-ceilometer13:17
openstackgerritChris Dent proposed openstack/ceilometer: Add a batch_polled_samples configuration item  https://review.openstack.org/20614813:38
cdentthere ya go gordc_meeting I made it nice an unreadable13:39
cdentjasonamyers: you about? did we talk about this?13:40
cdenthttps://bugs.launchpad.net/ceilometer/+bug/147436913:40
openstackLaunchpad bug 1474369 in Ceilometer "ceilometer.hardware.discovery polls nova api without bound" [Undecided,New]13:40
jasonamyerscdent: we didn't talk about it, but I can get a patch in for it13:40
jasonamyersworking on ceilo tomorrow13:41
cdentcool, it's effectively the same as what you did on the compute pollster isn't it?13:41
jasonamyersyeap13:41
cdentossum13:41
gordc_ghostcdent:lol i mean it could be cleaner. :P13:43
*** pauldix has joined #openstack-ceilometer13:43
gordc_ghostcdent: you can leave your previous code. i can put a patch up (after seeing whether or not it reduces processing)13:44
cdentthis new version is more in line with what you were suggestion13:44
cdentsuggest_ing_13:44
cdentthe only egregious thing in the latest patchset is the funky side-effecty list.extend13:45
pradgordc_ghost, so adding data_files to setup.cfg dint make a difference, ill push the patch with ghost yaml file in a bit..13:45
pradgordc_ghost, thx for commenting on the patch .. faint hope it might change sdague's mind13:46
cdentprad did you guys come up with a devious plan?13:46
pradcdent, so one option we discussed is to have a minimal ghost yaml file somewhere hidden to satisfy grenade and remove it in the immediate next cycle13:47
gordc_ghostcdent: we can use your patch if there's weird side effect. i was just suggesting it to see if you would bite.13:47
cdentyou'll take what your given gordc_ghost !13:48
gordc_ghostcdent: the idea was to have hardcoded internal version. if you don't have meter.yaml, it will fall back on the internal version (which is not meant to be modified)13:48
cdentah, so if you want to make any changes you start with a copy?13:48
gordc_ghostcdent: err... not exactly. it'll just look for meter.yaml file in /etc/ceilometer (or whereever)13:49
pradcdent, well /etc/ceilo/meter.yaml is the official one.. the ghost file is just to staisfy grenade and not meant to be changed unless you have tempest tests13:50
gordc_ghostif we don't find it, we'll use an meter.yaml file internal to package... which would be full mapping.13:50
cdentah I see13:50
cdentso if you do that then nothing needs to be done to grenade at all, right?13:50
cdentyou can just abandon the pending patch13:51
pradthats the hope, yes13:51
cdentseems reasonable13:51
*** belmoreira has quit IRC13:51
*** edmondsw has joined #openstack-ceilometer13:51
cdentwhy ever remove the ghost?13:52
cdentwhy not just keep it?13:52
pradso we dot have to maintain two yamls and worry about keeping them in sync?13:52
pradonce the yaml is in Liberty, grenade will be fine i think13:52
cdentyou wouldn't maintain two13:52
cdentin devstack install you just copy the ghost13:53
cdentor hell, do nothing13:53
pradwell for tempest needs we would ?13:53
cdentwhat aspects of tempest?13:53
pradah you mean do the copy at devstack time, not in the code?13:53
* cdent nods13:54
pradif we have tempest tests that need certain meters13:54
cdentbut if you're not going to be making any changes to the file, there's no reason to copy13:54
pradwhat i was thinking was to have a copy in ceilo/meter/data/_meters.yaml13:54
pradand load that if /etc/ceilo/yaml is missing13:54
gordc_ghostcdent: that seems reasonable if it works.13:54
* cdent nods at prad13:55
*** fawadkhaliq has joined #openstack-ceilometer13:55
jasonamyerscdent: gordc_ghost do we want to solve https://bugs.launchpad.net/ceilometer/+bug/1474369 in the same patch with compute agent?13:55
gordc_ghostthe idea was just to ensure we don't need two13:55
openstackLaunchpad bug 1474369 in Ceilometer "ceilometer.hardware.discovery polls nova api without bound" [Undecided,New]13:55
pradyea if we can do it at devstack time, even better as we dont have to maintain a copy in the codebase13:55
cdentprad, that's not what I meant13:55
cdenti meant: maintain the copy in the codebase _only_13:55
cdentand at devstack time if you really feel like you must have an /etc/ceilo version, copy from the codebase13:56
cdenthowever, if you aren't making changes there's no reason to copy13:56
cdentjust use the defaults (which is what the version in codebase is)13:56
cdenttempest will still work13:56
gordc_ghostjasonamyers: separate patches should be fine.13:57
jasonamyerscool thanks13:57
pradcdent, gotcha13:57
*** jmatthew_ has joined #openstack-ceilometer13:58
* cdent has too many eggs13:58
cdentthe gate is still a bit grumpus14:00
*** ryanpetrello has joined #openstack-ceilometer14:03
ryanpetrellohey ceilometer folks, anybody know if there's any way to run ceilometer tests a bit...faster?14:03
ryanpetrelloI'm setting up some third-party CI for pecan14:03
ryanpetrelloand the ceilometer tests are just timing out after running for 15 or so minutes14:03
ryanpetrelloI confirmed it's not a connection issue; they just...take *forever* to run14:03
cdentryanpetrello: sounds like something is missing14:03
ryanpetrellosame on my laptop14:04
ryanpetrellocurrently on minute thirteen of the mongo tests running14:04
cdentryanpetrello: you could run less of them?14:04
cdentthey do take a long time14:04
ryanpetrelloyea14:04
ryanpetrelloI'd guess for pecan's purposes I probably mostly care about API-specific tests?14:04
cdentyou could run just the gabbi tests (which exercise the api) and have their own tox target14:05
ryanpetrelloyea, that's a good idea14:05
ryanpetrellodo those also require e.g., mongo to run?14:05
ryanpetrello(looks that way)14:06
gordc_ghostor tox -epy-mysql -- ceilometer.tests.api14:06
cdentyeah, they need a backend14:06
jasonamyersgordc_ghost: with the priority bump :P14:06
ryanpetrellocdent: when I run the gabbi tox target14:06
ryanpetrelloit fails with "2015-07-28 07:02:30.523 317 ERROR ceilometer NoSuchOptError: no such option in group api: gnocchi_is_enabled"14:06
gordc_ghostjasonamyers: :) it seems important.14:06
jasonamyershaha14:07
cdentryanpetrello: ah, that's new, just a sec14:07
*** tshtilma has joined #openstack-ceilometer14:09
*** boris-42 has joined #openstack-ceilometer14:10
cdentryanpetrello: there's a minor bug in the gabbi fixtures, which I'll fix14:12
ryanpetrellocool, thx14:12
cdentshort term you can instead tox -epy27 -- gabbi14:12
cdentand it will import the api group through other means14:12
ryanpetrellookay, great14:13
ryanpetrellothanks!14:13
openstackgerritChris Dent proposed openstack/ceilometer: Import the api opt group in gabbi fixture  https://review.openstack.org/20655614:14
cdentryanpetrello: that's ^ the fix14:14
ryanpetrelloawesome, thx14:14
ryanpetrelloalso, using py27 -- gabbi works fine for now, too14:14
ryanpetrellothanks :D14:14
cdentthe coverage is not 100% but it certainly exercises most of the pecan stuff14:15
ryanpetrelloyea14:15
ryanpetrellohonestly, it probably covers most of what I care about14:15
EmilienMI see two gordc, I'm drunk14:15
* cdent times tox -epy27 for curiosity14:17
*** tongli has joined #openstack-ceilometer14:18
ryanpetrellocdent: it was taking me 15+ minutes on my personal laptop and on Travis-CI14:18
cdentit's always been very long14:18
ryanpetrellothe gabbi tests run in under a minute14:18
cdentthe scenario tests for the backends are _endless_14:18
cdentryanpetrello: that speed is part of why I wrote gabbi, less overhead14:21
cdent(overhead in terms of test setup and teardown)14:21
cdentryanpetrello: 3501 tests, 3m33s14:21
cdent(243 skips)14:22
* cdent times again with a -r14:23
cdentI reckon something is causing delays for you ryanpetrello, more than just the tests being huge and long14:24
gordc_ghostEmilienM: you always drunk.14:26
cdentno huge difference on -r (but I have a hot wheelhouse)14:28
cdentI guess 8 core 32GB is a win...14:28
*** jmatthew_ has quit IRC14:29
ryanpetrellocdent: yea, that very well may be it14:29
*** jaypipes has joined #openstack-ceilometer14:29
cdentseems a bit extreme though14:29
*** fawadk has joined #openstack-ceilometer14:30
*** fawadkhaliq has quit IRC14:30
ryanpetrelloalso, on my computer at least, the amount of time on downloading installing seems pretty low14:30
ryanpetrellomost of the time spent seems to be on test running14:30
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: reduce the number of patch to gnocchi API  https://review.openstack.org/20258914:30
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Adds batch dispatcher  https://review.openstack.org/20334914:30
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: concurrently post resource/measures  https://review.openstack.org/20355314:30
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: retry with a new token on 401  https://review.openstack.org/20656014:30
cdentryanpetrello: that would what I would expect14:30
cdentI guess in the end switching a gabbi-based subset is probably a win anyway14:31
*** fawadkhaliq has joined #openstack-ceilometer14:33
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: DONT MERGE: check live tests run in gate  https://review.openstack.org/20651214:33
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Add tests to not break ceilometer dispatcher  https://review.openstack.org/20651114:33
*** jmatthew_ has joined #openstack-ceilometer14:33
*** fawadk has quit IRC14:33
EmilienMgordc_ghost: meh14:44
*** ddaskal has joined #openstack-ceilometer14:48
*** jwcroppe has quit IRC14:52
*** jwcroppe has joined #openstack-ceilometer14:52
*** ddieterly has joined #openstack-ceilometer14:55
*** jwcroppe has quit IRC14:56
openstackgerritJulien Danjou proposed openstack/aodh: Stop using global conf object  https://review.openstack.org/20657314:58
*** ddieterly has quit IRC14:58
silehtjd__, yeah the last piece of your jenga ;)15:00
*** ddieterly has joined #openstack-ceilometer15:00
jd__hehe15:00
*** ddieterl_ has joined #openstack-ceilometer15:02
*** yprokule has quit IRC15:03
*** ddieterl_ has quit IRC15:05
*** ddieterly has quit IRC15:05
*** gordc_meeting has quit IRC15:12
*** vishwanathj has quit IRC15:20
*** yprokule has joined #openstack-ceilometer15:20
*** exploreshaifali has quit IRC15:21
*** ddieterly has joined #openstack-ceilometer15:22
*** ddieterly has quit IRC15:26
*** tongli_ has joined #openstack-ceilometer15:28
openstackgerritPradeep Kilambi proposed openstack/ceilometer: Enable entry points for new declarative meters  https://review.openstack.org/20303215:30
openstackgerritJulien Danjou proposed openstack/aodh: storage: only retry connection, not driver finding  https://review.openstack.org/20658915:31
*** tongli has quit IRC15:31
*** jmatthew_ has quit IRC15:36
*** jmatthew_ has joined #openstack-ceilometer15:38
*** gordc_ghost has quit IRC15:42
*** gordc has joined #openstack-ceilometer15:45
*** alexpilotti has quit IRC15:47
cdentsileht: is it expected that notification_listeners will sit in a tight epoll_wait syscall loop? I was kind of assuming they'd idle until something happens. Is that just an artifact of eventlet's way of waiting?15:50
cdent(see https://bugs.launchpad.net/ceilometer/+bug/1478135 for context)15:50
openstackLaunchpad bug 1478135 in Ceilometer "notification agent never idles" [Undecided,New]15:50
silehtcdent, yes15:50
cdent:(15:51
*** _cjones_ has joined #openstack-ceilometer15:51
*** changbl has joined #openstack-ceilometer15:52
silehtcdent, but I'm suprised that epoll load the CPU like taht15:53
cdentthere are many listeners being created15:53
cdentand I'm not certain it is that that is causing the load15:53
silehtcdent, how many ?15:53
cdentgordc: how many listeners created in your new multiple listener stuff?15:53
silehtoh oki :p by default just 1 so15:54
cdentthe reason I think it is that causing the load is because there are zero other system calls happening when the notification agent is doing nothing15:54
cdentno, I don't think 1 is the case15:54
*** logan2 has quit IRC15:55
cdentbut perhaps it is15:55
silehtthe event pipeline coordinator perhaps creates many other listeners15:57
* cdent shrugs15:58
cdentin any case, an idle notification-agent is sitting in epoll_wait and nothing else, that's all I know15:58
cdentmeanwhile an idle collector using mongodb as a backend is endlessly chattering with mongo for no apparent reason15:59
silehtkeepalive powered :p16:00
* cdent has a sad16:00
cdentwhy can't we have nice things16:00
*** lexholden has quit IRC16:02
*** ankita_wagh has joined #openstack-ceilometer16:04
*** safchain has quit IRC16:08
*** cdent has quit IRC16:18
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: retry with a new token on 401  https://review.openstack.org/20656016:22
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Adds batch dispatcher  https://review.openstack.org/20334916:22
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: concurrently post resource/measures  https://review.openstack.org/20355316:22
*** logan2 has joined #openstack-ceilometer16:24
*** jpparkin has joined #openstack-ceilometer16:29
*** _nadya_ has quit IRC16:45
*** _nadya_ has joined #openstack-ceilometer16:45
*** ankita_wagh has quit IRC16:46
*** ankita_wagh has joined #openstack-ceilometer16:47
*** rbak has quit IRC16:48
*** _nadya_ has quit IRC16:50
*** rbak has joined #openstack-ceilometer16:52
*** ankita_wagh has quit IRC16:53
*** rbak has quit IRC16:54
*** jaypipes has quit IRC16:54
*** jaypipes has joined #openstack-ceilometer16:55
openstackgerritJulien Danjou proposed openstack/aodh: storage: only retry connection, not driver finding  https://review.openstack.org/20658916:57
gordcsileht: if i have [# of agents] + [# of pipelines]*[# of agents] listeners is that going to be an issue?17:00
*** exploreshaifali has joined #openstack-ceilometer17:04
*** rbak has joined #openstack-ceilometer17:06
*** yprokule has quit IRC17:08
*** ankita_wagh has joined #openstack-ceilometer17:11
*** rbak has quit IRC17:14
silehtgordc, I don't known yet I will try tomorrow to take a look on that, the only thing I known is that each listener creates a threadpool (a green one with eventlet; of 64 threads), also each listener open one rabbitmq tcp connections17:18
silehtgordc, without heartbeat enabled, the rabbitmq connection is polled frequently17:20
*** boris-42 has quit IRC17:20
silehtif the number of listener is high, this can lead into many greenlet/context switch17:20
*** llu has quit IRC17:20
silehtwith heartbeat too, because of heartbeat packet regulary sent into the connection, but this is less that without heartbeat17:21
*** llu has joined #openstack-ceilometer17:21
silehtby default the number of pipeline is just 1, no ? so this should be a problem17:22
*** boris-42 has joined #openstack-ceilometer17:22
silehtsee you tomorrow17:22
gordcsileht: it's 1 per agent by default. it goes up when you have coordination... it goes up even more when you have distributed coordination...17:24
gordcwill sync up tomorrow. stupid fire alarm.17:24
*** yassine__ has quit IRC17:36
*** Ala has quit IRC17:42
*** Ala has joined #openstack-ceilometer17:54
*** fawadkhaliq has quit IRC17:55
*** changbl has quit IRC17:57
*** Ala has quit IRC17:59
*** fawadkhaliq has joined #openstack-ceilometer18:04
*** llu_linux has joined #openstack-ceilometer18:05
*** fawadkhaliq has quit IRC18:05
*** llu has quit IRC18:05
*** changbl has joined #openstack-ceilometer18:10
*** renatoarmani has joined #openstack-ceilometer18:19
*** vishwanathj has joined #openstack-ceilometer18:21
*** vishwana_ has joined #openstack-ceilometer18:25
*** vishwanathj has quit IRC18:25
*** vishwana_ has quit IRC18:27
*** rbak has joined #openstack-ceilometer18:27
*** _nadya_ has joined #openstack-ceilometer18:31
*** tshtilma has quit IRC18:32
*** _nadya_ has quit IRC18:38
*** _nadya_ has joined #openstack-ceilometer18:38
*** fawadkhaliq has joined #openstack-ceilometer18:39
*** _nadya_ has quit IRC18:43
*** ddaskal has quit IRC18:44
*** ankita_wagh has quit IRC19:01
*** ankita_wagh has joined #openstack-ceilometer19:02
*** jpparkin has quit IRC19:05
*** jpparkin has joined #openstack-ceilometer19:05
*** r-mibu has quit IRC19:05
*** rbak has quit IRC19:05
*** jmatthew_ has quit IRC19:06
*** ankita_wagh has quit IRC19:06
*** r-mibu has joined #openstack-ceilometer19:11
*** fawadk has joined #openstack-ceilometer19:11
*** fawadkhaliq has quit IRC19:12
openstackgerritJason Myers proposed openstack/ceilometer: Instance Caching  https://review.openstack.org/20438819:14
gordcjasonamyers: i don't think you need a test tbh.19:14
jasonamyersgordc: It looks like the current testing works for it19:15
gordcthe only thing that isn't explicitly covered is whether last_run time is set.. but it's pretty self evident19:15
*** rbak has joined #openstack-ceilometer19:16
gordcjasonamyers: i'm going to +2. we might be able to get this in by liberty-2 if someone merges it in morning19:16
jasonamyersawesome thanks gordc gonna work on the other one now19:17
gordcjasonamyers: cool cool. get on it! :)19:18
jasonamyerswell you made it high19:18
gordc:) /me is lighting fires19:19
jasonamyersgordc: actually this one needs the fixed get_all_from_host thing19:20
jasonamyersfirst19:20
jasonamyersnevermind I need to read more19:20
gordc"this one" == "patch for bug"?19:21
jasonamyersignore me had a mental moment19:21
*** exploreshaifali has quit IRC19:21
gordc:)19:23
*** ddaskal has joined #openstack-ceilometer19:28
*** pauldix has quit IRC19:31
*** pauldix has joined #openstack-ceilometer19:31
openstackgerritJason Myers proposed openstack/ceilometer: Instance Cache in Node Discovery Pollster  https://review.openstack.org/20666519:34
*** ankita_wagh has joined #openstack-ceilometer19:34
*** rbak has quit IRC19:35
jasonamyershttps://review.openstack.org/#/c/204388/ never seen an Intel IPMI failure19:35
jasonamyersi didn't touch that I swear :P19:35
gordcjasonamyers: you can ignore those. i think majority of failures are because the network sucks19:36
gordcthe server i think is in China somewhere.19:36
jasonamyersit sent me a nasty failure... IT MUST DIE19:37
gordclol19:39
gordcnot related but did you ever test your patch on your 10node environment?19:40
jasonamyersgordc: that's my tomorrow agenda19:40
jasonamyersI got it installed and it's been running, but I've not had time to measure19:40
*** rbak has joined #openstack-ceilometer19:40
gordccool cool. i'm just curious to see what you get. no rush19:40
jasonamyersI got 9 with it and one without actually19:44
jasonamyersso now I need to figure out what all to measure, gonna be hard with all the noise around the data19:44
jasonamyersI mean I get api calls etc19:44
jasonamyersbut hard to decide load since it's relative to the box.19:45
*** rbak has quit IRC19:47
gordctrue true. i imagine we just want to see load on compute controller or nova-api processes with/without your patch applied to all compute agents19:49
gordcbut i guess we don't know when polling with sync up.19:49
gordcyou could change them all to poll at a very short interval to see roughly what happens when they poll together19:50
*** julim has quit IRC19:55
openstackgerritMerged openstack/ceilometer: Import the api opt group in gabbi fixture  https://review.openstack.org/20655619:56
*** vgnbkr has joined #openstack-ceilometer19:59
*** renatoarmani has quit IRC19:59
vgnbkrHi all. General question: If I'm implementing notifications with a start|end|error paradigm, should I still emit a .end event if I have already had an error and sent a .error event?20:00
vgnbkri.e, should it be start => error => end, or just start => error?20:01
gordcvgnbkr: i would think having the corresponding end would be the most useful... that said, if it's an unexpected error you may not actually get to end step20:03
*** rbak has joined #openstack-ceilometer20:03
vgnbkrgordc, OK, thanks.  I couldn't find anything on the web which suggested the preferred behaviour.  I'll have it do start => error => end if I can.20:04
*** alexpilotti has joined #openstack-ceilometer20:06
*** _nadya_ has joined #openstack-ceilometer20:07
openstackgerritMerged openstack/ceilometer: storage: deprecates mongodb_replica_set option  https://review.openstack.org/20607320:07
gordcvgnbkr: sounds good to me.20:07
*** rbak has quit IRC20:11
*** ankita_w_ has joined #openstack-ceilometer20:12
*** alexpilotti has quit IRC20:12
*** ankita_wagh has quit IRC20:15
*** rbak has joined #openstack-ceilometer20:17
*** ankita_wagh has joined #openstack-ceilometer20:19
*** jpparkin has quit IRC20:20
*** jaypipes has quit IRC20:20
*** ankita_w_ has quit IRC20:22
*** julim has joined #openstack-ceilometer20:22
*** rbak has quit IRC20:27
*** jaypipes has joined #openstack-ceilometer20:31
*** _nadya_ has quit IRC20:37
*** _nadya_ has joined #openstack-ceilometer20:37
*** lexholden has joined #openstack-ceilometer20:39
*** _nadya_ has quit IRC20:41
*** gordc has quit IRC20:41
*** alexpilotti has joined #openstack-ceilometer20:42
*** logan2 has quit IRC20:42
*** logan2 has joined #openstack-ceilometer20:45
*** alexpilotti has quit IRC20:52
openstackgerritPradeep Kilambi proposed openstack/ceilometer: Convert identity, sahara and image to meters yaml  https://review.openstack.org/20303120:54
jasonamyersgate is slowish today20:56
*** fawadk has quit IRC20:57
*** jaypipes has quit IRC21:04
pradjasonamyers, yea py34 is not even starting, something wrong i guess21:04
*** thorst has quit IRC21:07
*** jruano has quit IRC21:07
openstackgerritPradeep Kilambi proposed openstack/ceilometer: Update install docs with gnocchi dispatcher info  https://review.openstack.org/20611021:15
*** vishwanathj has joined #openstack-ceilometer21:31
*** vishwanathj has quit IRC21:36
*** jaosorior has quit IRC21:41
*** gordc has joined #openstack-ceilometer21:42
*** jruano has joined #openstack-ceilometer21:51
*** jwcroppe has joined #openstack-ceilometer21:52
*** vishwanathj has joined #openstack-ceilometer21:52
*** changbl has quit IRC21:53
*** ankita_w_ has joined #openstack-ceilometer21:59
*** vishwanathj has quit IRC22:00
*** ankita_wagh has quit IRC22:02
*** ddaskal has quit IRC22:04
*** vishwanathj has joined #openstack-ceilometer22:04
*** jruano has quit IRC22:05
*** vishwanathj has quit IRC22:09
*** jruano has joined #openstack-ceilometer22:13
*** gordc has quit IRC22:31
*** jruano has quit IRC22:46
*** jruano has joined #openstack-ceilometer22:59
*** edmondsw has quit IRC23:07
*** jruano has quit IRC23:09
*** r-daneel has joined #openstack-ceilometer23:24
*** r-daneel has quit IRC23:24
*** r-daneel has joined #openstack-ceilometer23:25
*** pauldix has quit IRC23:51

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!