Wednesday, 2014-10-15

*** ccrouch has quit IRC00:05
*** ccrouch has joined #openstack-ceilometer00:16
*** _cjones_ has quit IRC00:18
*** _cjones_ has joined #openstack-ceilometer00:19
*** _cjones_ has quit IRC00:23
*** sdake_ has joined #openstack-ceilometer00:33
*** alexpilotti has quit IRC00:40
*** sbfox has joined #openstack-ceilometer00:42
*** shakayumi has quit IRC00:45
*** sbfox has quit IRC01:05
*** fnaval has quit IRC01:08
*** sdake_ has quit IRC01:13
*** rwsu has quit IRC01:30
*** jmanko has quit IRC01:32
*** fnaval has joined #openstack-ceilometer01:32
*** zhiyan|afk has joined #openstack-ceilometer01:32
*** ondergetekende_ has joined #openstack-ceilometer01:32
*** sileht_ has joined #openstack-ceilometer01:32
*** rwsu has joined #openstack-ceilometer01:33
*** theanalyst has quit IRC01:33
*** dougwig has quit IRC01:33
*** ondergetekende has quit IRC01:33
*** zhiyan has quit IRC01:33
*** dougwig has joined #openstack-ceilometer01:33
*** sileht has quit IRC01:33
*** dougwig has quit IRC01:33
*** dougwig has joined #openstack-ceilometer01:33
*** zhiyan|afk is now known as zhiyan01:34
*** theanalyst has joined #openstack-ceilometer01:34
*** openstack has joined #openstack-ceilometer01:42
*** eglynn_ has joined #openstack-ceilometer01:42
*** andreluiz has joined #openstack-ceilometer01:42
*** dougwig has quit IRC01:42
*** theanalyst has quit IRC01:42
*** eglynn has quit IRC01:42
*** dougwig has joined #openstack-ceilometer01:42
*** dekozo has quit IRC01:42
*** dougwig has quit IRC01:42
*** dougwig has joined #openstack-ceilometer01:42
*** larsks|alt has joined #openstack-ceilometer01:43
*** openstackgerrit has joined #openstack-ceilometer01:52
*** nosnos has joined #openstack-ceilometer01:52
*** theanalyst has joined #openstack-ceilometer01:52
*** shakamunyi has joined #openstack-ceilometer01:58
*** sdake_ has joined #openstack-ceilometer01:59
*** sdake has quit IRC02:10
*** larsks|alt is now known as larsks02:12
*** hhuang has joined #openstack-ceilometer02:17
*** harlowja is now known as harlowja_away02:21
*** shakayumi has joined #openstack-ceilometer02:24
*** shakamunyi has quit IRC02:27
*** shardy has quit IRC02:32
*** sdake_ has quit IRC02:37
*** sdake_ has joined #openstack-ceilometer02:43
*** Longgeek has joined #openstack-ceilometer02:49
*** amalagon has quit IRC03:06
*** X019 has quit IRC03:37
*** deepthi has joined #openstack-ceilometer03:45
*** X019 has joined #openstack-ceilometer03:50
*** nosnos has quit IRC03:50
*** nosnos has joined #openstack-ceilometer03:51
*** nosnos has quit IRC03:55
*** renlt has joined #openstack-ceilometer04:07
*** hhuang has quit IRC04:24
*** swamireddy has joined #openstack-ceilometer04:25
*** nosnos has joined #openstack-ceilometer04:30
*** hhuang has joined #openstack-ceilometer04:41
*** yatin has joined #openstack-ceilometer04:44
*** sbfox has joined #openstack-ceilometer04:47
*** ildikov has quit IRC04:58
*** sdake_ has quit IRC05:02
*** amalagon has joined #openstack-ceilometer05:07
*** sileht_ is now known as sileht05:38
*** sileht has joined #openstack-ceilometer05:40
*** amalagon has quit IRC05:42
*** ifarkas has joined #openstack-ceilometer05:43
*** ildikov has joined #openstack-ceilometer05:57
*** cmyster has joined #openstack-ceilometer06:00
*** cmyster has joined #openstack-ceilometer06:00
*** amalagon has joined #openstack-ceilometer06:05
*** zigo has joined #openstack-ceilometer06:08
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ceilometer: Imported Translations from Transifex  https://review.openstack.org/12772306:10
*** Ala has joined #openstack-ceilometer06:14
*** Ala has quit IRC06:20
*** Ala has joined #openstack-ceilometer06:20
*** asalkeld has quit IRC06:35
*** asalkeld has joined #openstack-ceilometer06:52
*** Guest86578 is now known as d0ugal07:04
*** d0ugal has quit IRC07:05
*** d0ugal has joined #openstack-ceilometer07:05
*** ccrouch has quit IRC07:08
*** ccrouch has joined #openstack-ceilometer07:09
*** shardy has joined #openstack-ceilometer07:25
*** eglynn_ has quit IRC07:29
*** eglynn_ has joined #openstack-ceilometer07:34
*** _nadya_ has joined #openstack-ceilometer07:35
*** safchain has joined #openstack-ceilometer07:52
*** liusheng has joined #openstack-ceilometer07:58
*** alexpilotti has joined #openstack-ceilometer08:11
openstackgerritSamta Rangare proposed a change to openstack/ceilometer: Alarms listing based on "timestamp"  https://review.openstack.org/12857308:14
*** rwsu has quit IRC08:31
*** rwsu has joined #openstack-ceilometer08:56
*** _nadya_ has quit IRC09:11
*** eglynn__ has joined #openstack-ceilometer09:13
*** eglynn_ has quit IRC09:14
*** eglynn__ is now known as eglynn09:15
*** nellysmitt has joined #openstack-ceilometer09:23
*** lsmola has quit IRC09:26
*** admin0 has joined #openstack-ceilometer09:32
*** renlt has quit IRC09:34
*** hhuang has quit IRC09:35
*** lsmola has joined #openstack-ceilometer09:42
*** cdent has joined #openstack-ceilometer10:04
*** Ala has quit IRC10:22
*** Ala has joined #openstack-ceilometer10:22
*** claudiub has joined #openstack-ceilometer10:25
openstackgerritChris Dent proposed a change to openstack/ceilometer: Add a console-script to inspect coordination groups  https://review.openstack.org/12727110:42
*** safchain has quit IRC10:45
*** asalkeld has left #openstack-ceilometer10:55
*** sbfox has quit IRC11:07
*** julim has joined #openstack-ceilometer11:09
nellysmitteglynn: Hi! Could you please tell what is the current status of this bluprint? https://blueprints.launchpad.net/ceilometer/+spec/neutron-ceilometer-floating-ip-association11:34
*** swamireddy1 has joined #openstack-ceilometer11:37
eglynnjd__: ^^^ that's one of your BPs that nellysmitt is asking about ... do you remember the backgroud to it, or whether the idea is still relevant?11:37
nellysmitteglynn: it seems that update events are implemented but delete notifications are not handled11:38
nellysmitthttps://github.com/openstack/ceilometer/blob/master/ceilometer/network/notifications.py#L5611:39
nellysmittshould it be fixed?11:39
*** swamireddy has quit IRC11:40
eglynnnellysmitt: you'd need to check if dhellmann's observation in that comment still holds true11:42
DinaBelovaeglynn, nellysmitt and I looked on this Bp - it looks like as we're processing ip.floating.update notificaitons, it's fixed already11:42
DinaBelovanot sure really :)11:42
eglynnDinaBelova: nellysmitt's question was on the handling of the delete as opposed to update notifications11:43
*** _nadya_ has joined #openstack-ceilometer11:43
eglynnDinaBelova: which aren't handled IIUC, as the notification from neutron was apparently incomplete11:43
DinaBelovaeglynn, I guess it's kind of separated quesiotns...11:44
eglynnDinaBelova: a-ha, ok11:44
DinaBelovaassosiation in the Bp looks like update11:44
DinaBelovaand eleteion is not supported for all neutron notificaitons11:44
DinaBelovadeletion*11:44
eglynnnellysmitt: I'd recommend double-checking in the neutron code that the deletion notification is still incomplete11:44
*** swamireddy1 has quit IRC11:44
eglynnnellysmitt: if it is, it would have to be fixed on the neutron side11:45
nellysmittok, I'll check11:45
eglynnnellysmitt: (BTW that would be a valid contribution to support your OPW application, patch doesn't necessarily have to apply to the same project repo)11:46
DinaBelovaeglynn, that's why we've started this research :)11:46
eglynnDinaBelova: cool11:46
nellysmittindeed, projects can be different11:47
*** safchain has joined #openstack-ceilometer11:50
DinaBelovanellysmitt, you can try to debug it on your devstack or ask some neutron folks about this moment11:50
nellysmittgood idea, will do :)11:50
*** deepthi has quit IRC11:51
eglynnnellysmitt: OPW application deadline is Oct 22, amiright?11:51
nellysmittyup11:51
nellysmittI have a small docco contribution for now11:52
nellysmittso, in theory I can apply already11:52
*** cmyster has quit IRC11:52
*** Ala has quit IRC11:52
nellysmittbut I want more :D11:52
eglynnnellysmitt: yeah I was gonna suggest getting a "banker" patch landed just as insurance11:52
eglynnnellysmitt: ... but I see you've already gone and done that https://review.openstack.org/#/q/owner:nellysmitt,n,z11:53
eglynnnellysmitt: ... way ahead of me :)11:53
nellysmitt:D11:53
_elena_ildikov, I want to add some information about cinder-volume-usage-audit to the admin guide, where can I do it? I can't see needed file in ceilo docs, is it in the separated repo or I missed smth?11:55
*** mspreitz has joined #openstack-ceilometer11:56
* cdent goes walkies12:06
DinaBelovanellysmitt, eglynn - fyi - http://paste.openstack.org/show/121232/ and http://paste.openstack.org/show/121233/ shows the difference between notificaiton info for create.start and delete.start notifications - difference is in the payload, actually12:07
DinaBelovafor delete there is ID there, for create - name, etc.12:07
*** amalagon has quit IRC12:08
*** jdandrea has quit IRC12:09
eglynnDinaBelova: yeah, isn't that pretty much what dhellmann's comment was saying in the code - different/incomplete metadata in the notification payload?12:09
DinaBelovaeglynn, yeah, it looks like so12:09
*** jdandrea has joined #openstack-ceilometer12:09
DinaBelovaalthough I'm not sure12:10
DinaBelovaif it's a blocker12:10
DinaBelovaand how does it influence of the delete notifications...12:10
DinaBelovaI guess I don't understand some metadata moment here12:10
eglynnDinaBelova: I'd imagine dhellmann's reasoning was the last sample for that the neutron resource wouldn't show up in the same query as the previous samples12:11
eglynnDinaBelova: ... as say the project_id is set correctly in the previous samples, but not the last sample derived from the delete notification12:12
eglynnDinaBelova: ... (just using project_id as an example there, subsitute any field you're seeing missing from the delete notification)12:12
eglynncdent: hola12:14
eglynncdent: I've got a build of a new openstack-ceilometer-ipmi RPM for fedora12:14
eglynncdent: ... you wanna give it a whirl on your baremetal setup?12:14
eglynncdent: (... I'll mail ya the yum repo details)12:15
DinaBelovaeglynn, a-ha, cool - I suppose we can suggest nellysmitt to fix the notificaiton format for the *.*.end notificaitons - to add there all the info we're having for the *.*.create + resource id12:19
DinaBelovaeglynn - did I get it correclty?12:19
*** anna_ has joined #openstack-ceilometer12:19
eglynnDinaBelova: my understanding is that the info available in the *.delete.end notification payload should match the *.create.end12:21
DinaBelovaeglynn, yeah, sorry, wrong phrase12:22
DinaBelovaeglynn, you're right12:22
*** X019 has quit IRC12:22
eglynncool :)12:33
*** jmank has joined #openstack-ceilometer12:35
*** anna_ is now known as X01912:41
cdenteglynn: I'm back now, yeah, happy to give it a god12:42
cdentgo!12:42
eglynncdent: thank you sir! (... I've mailed repo details offline)12:42
*** jmatthews has joined #openstack-ceilometer12:42
cdent12:43
*** jaypipes has joined #openstack-ceilometer12:49
DinaBelovaeglynn, fyi https://bugs.launchpad.net/neutron/+bug/138150412:50
eglynnDinaBelova: thanks!12:51
DinaBelovaeglynn, after that nellysmitt will remove that dhellmann's comment and reanable the delete notifications :)12:51
DinaBelovanice :)12:51
eglynncoolness :)12:52
*** pradk has joined #openstack-ceilometer12:54
*** claudiub has quit IRC12:57
*** isviridov is now known as isviridov_away13:02
ildikov_elena_: hi13:05
ildikov_elena_: here you can find the sections of the Telemetry Admin Guide chapter: https://github.com/openstack/openstack-manuals/tree/master/doc/admin-guide-cloud/telemetry13:06
DinaBelovaildikov, _elena_ - it looks like section_telemetry-data-collection.xml seems to be the right place?13:06
*** Dafna has quit IRC13:06
_elena_ildikov, thanks!13:08
_elena_DinaBelova, i think yes13:08
DinaBelovaщл13:08
DinaBelovaok*13:08
*** Ala has joined #openstack-ceilometer13:09
*** gordc has joined #openstack-ceilometer13:10
*** yatin has quit IRC13:11
ildikovDinaBelova: _elena_: yeap, it looks like that section will be the one13:12
openstackgerritgordon chung proposed a change to openstack/ceilometer: add script to generate test event data  https://review.openstack.org/12844513:13
*** swamireddy has joined #openstack-ceilometer13:15
_elena_ildikov, may you help me? I added something to xml, how can i generate this xml to see what happened?13:15
ildikov_elena_: one sec, I will look for the link to the guideline13:15
*** IvanBerezovskiy has left #openstack-ceilometer13:16
*** ala_ has joined #openstack-ceilometer13:17
openstackgerritgordon chung proposed a change to openstack/ceilometer: refactor hbase storage code  https://review.openstack.org/12759113:19
openstackgerritgordon chung proposed a change to openstack/ceilometer: refactor hbase storage code  https://review.openstack.org/12759113:19
*** Ala has quit IRC13:20
*** alexpilotti has quit IRC13:24
ildikov_elena_: here it is: https://wiki.openstack.org/wiki/Documentation/HowTo#Download_the_documentation13:27
_elena_ildikov, thanks!13:28
ildikov_elena_: you will need maven, the guide tells you how to install and what command you need to run13:28
ildikov_elena_: I only had xml formatting issues, nothing specific to maven, so you should be able to make it work easily13:29
_elena_ildikov, ok, i'll try13:32
*** ala_ has quit IRC13:32
sileht/1/113:38
*** eglynn has quit IRC13:42
*** eglynn has joined #openstack-ceilometer13:43
*** _nadya_ has quit IRC13:49
*** _nadya_ has joined #openstack-ceilometer13:49
*** _nadya__ has joined #openstack-ceilometer13:52
openstackgerritA change was merged to openstack/ceilometer: Add missing alarm options to the documentation  https://review.openstack.org/12790813:52
*** _nadya_ has quit IRC13:52
*** sdake_ has joined #openstack-ceilometer13:59
cdenteglynn this is taking considerably longer than expected: i'm not actually ipmi enabled so I have to hack the ipmitool calls to talk to the remote host14:02
cdentwhich requires vpn14:02
cdentwhich tends to irregularly break my network for setting other requirements up14:03
* cdent hates vpn14:03
eglynncdent: ok, I'll crack on with some other packaging changes in the meantime14:03
eglynncdent: (RC3 rebase etc.)14:04
eglynncdent: thanks!14:04
cdentat base level it works as expected: just not yet able to get it to give me samples, but should have that soonish14:04
cdentvpn being on breaks glance, strange14:07
*** swamireddy has quit IRC14:10
*** isviridov_away is now known as isviridov14:12
*** shakayumi has quit IRC14:12
*** rbak has joined #openstack-ceilometer14:14
*** sdake has joined #openstack-ceilometer14:15
eglynncdent: that is indeed weird (vpn breaking glance)14:19
eglynncdent: BTW in the latest build I fixed the dumb {neutron|nova|keystone}client errors you would have seen in the agent-ipmi.logs14:20
eglynn(dumb in the sense that we load all the discovery extensions whether they're needed or not)14:20
eglynn(... so we need those clients installed alongside the ipmi agent, even though they'll never be used)14:20
cdenturgh14:21
*** alexpilotti has joined #openstack-ceilometer14:23
*** fnaval has quit IRC14:27
*** sbfox has joined #openstack-ceilometer14:29
*** alexpilotti has quit IRC14:29
jd__aye14:32
*** jergerber has joined #openstack-ceilometer14:43
*** cdent has quit IRC14:45
*** tasdomas` is now known as tasdomas14:45
ildikov_elena_: just a quick question, if you're still around14:45
*** cdent has joined #openstack-ceilometer14:45
ildikov_elena_: I was wondering if you're docco would fit more to the Cinder config part of the Install guide here: http://docs.openstack.org/trunk/install-guide/install/apt/content/ceilometer-install-cinder.html or not14:46
ildikov_elena_: so I would like to ask your opinion too here, TBH, I wasn't 100% aware of what you plan to add and after reading it, I had this thought in mind14:49
*** Longgeek has quit IRC14:49
ildikoveglynn: hi14:49
eglynnildikov: hey14:50
ildikoveglynn: as you're my warrior prince regarding to the docco fight, if you have an opnion about the question I've just asked _elena_ about, it's welcomed :)14:51
* eglynn reads backlog14:52
ildikoveglynn: tnx, small question, I'm just not 100% sure this time, so I need opinions :)14:52
jdandreaI'm trying to create a sample and looking at http://docs.openstack.org/developer/ceilometer/webapi/v2.html ... I think I should be using the nomenclature in Sample and not OldSample (e.g., 'meter' and not 'counter_name'). However, even though I use the v2 API samples.create wants counter_name (?).14:54
ildikoveglynn: I've just added you as reviewer to the docco patch I asked about14:54
eglynnildikov, _elena_: even though that volume audit script is strictly part of the cinder installation/setup, it's really doing work on behalk of ceilometer14:54
eglynn... so seems more logical to put in in the telemetry data collection section14:54
ildikoveglynn: _elena_: ok, I had the other viewpoit in mind, so that what has to be done to get data out of Cinder14:56
eglynnjdandrea: are you POSTing to /v2/meters/meter_name ?14:57
eglynnjdandrea: ... the docco is pretty clear that this expects the OldSample format14:58
jdandreaeglynn: I'm using the python bindings.14:58
ildikoveglynn: _elena_: ... so that what should be configured/used14:58
jdandreaceclient = ceilometerclient.client.get_client(2, **cecreds)14:58
jdandreaeglynn: Ohhhh. I saw "deprecated in favor of" and immediately thought I should start using Sample.14:59
ildikoveglynn: _elena_: but well the other viewpoint sounds logical too :)14:59
DinaBelovaildikov, eglynn - _elena_ is afk :)15:00
eglynnildikov: TBH I don't have a strong opinion, that was purely a gut reaction15:00
DinaBelovashe'll go through your messages asap15:00
ildikovDinaBelova: I thought so, but anyway, she can read the logs later, it's not that pretty urgent anyway15:01
DinaBelova:)15:01
ildikovDinaBelova: I just had a question in mind and as the patch is in the docco repo, I thought it's better to quickly ask here15:01
ildikovDinaBelova: so if she answers later or tomorrow, that should be fine also15:03
DinaBelovaildikov, a-ha, ok15:03
ildikoveglynn: I don't have a strong opinion either, that is why I thought to ask15:03
ildikoveglynn: as an experience, I'm lazy to read docco, so it seemed a bit more logical to me to point the user to what options need to be used and set in order to be able to collect data in one place, but it's still more a feeling, than a strong opinion15:08
ildikoveglynn: anyway, thanks for sharing your thoughts, I will think this over once more and then put my decision on gerrit :)15:09
eglynnildikov: sure, how about putting the detail in the cinder section and a cross-section link to that from the telemetry section?15:09
ildikoveglynn: I always forget about the cross section link option, but that sounds a good idea to me actually15:10
eglynncool15:10
ildikoveglynn: thanks, I will add a comment on gerrit then15:12
cdenteglynn: i'm sad to report that I have found a bug in the ipmi agent code15:13
eglynncdent: rootwrap sudoers?15:13
cdentnope15:13
cdentif it can't parse a single sensor, it drops all the samples15:13
eglynncdent: one fails, they all fail?15:14
cdentyes15:14
cdenti'm just confirming the fix now (to see if my analysis is correct)15:14
eglynncdent: interesting, which one is failing?15:14
cdentoh, all of them15:14
cdentbecause the code is supposed to ignore stuff it doesn't understand15:15
cdentand then carry on with stuff it does15:15
cdentbut there will always be at least one thing that doesn't make sense15:15
*** alexpilotti has joined #openstack-ceilometer15:15
eglynncdent: a-ha, k ... can you file a bug once you've confirmed your RCA?15:15
* cdent nods15:15
eglynncdent: ... at this stage we'll prolly have to just carry the fix on stable/juno :(15:16
cdentI reckon even after this is fixed it would be very wise to do some testing in a correct hardware an installation sense15:16
cdentbecause I've got a lot of bailing wire here15:16
eglynncdent: BTW I noticed that I'd hosed the rootwrap config in that package, rebuilding currently15:16
cdentyeah, I'm working around that at the moment15:17
cdentthat's one of the things that I think a "proper install" will confirm15:17
*** fnaval has joined #openstack-ceilometer15:17
cdent\o/ I have samples!15:17
cdentso the bug is real and the fix is right15:17
cdentmeh15:17
eglynncdent: cool, let's get the fix landed on master at least15:18
cdentthis particular set of code has not been our finest hour :(15:18
eglynnyeap, agreed15:19
*** sbfox has quit IRC15:20
eglynncdent: BTW that package with fixed rootwrap sudoers is now up if you wanna pick latest15:25
eglynn(yum remove -y openstack-ceilometer-ipmi ; yum --enablerepo=copr-juno-testing clean metadata ; yum install -y openstack-ceilometer-ipmi)15:26
eglynncdent: despite the bug you've found, I'm inclined to push the packaging updates at least15:26
eglynn(since the sources are still based on RC2 in any case)15:26
*** nosnos has quit IRC15:27
cdentmakes sense, i'll try that in a mo15:27
cdentthere's the bug eglynn : https://bugs.launchpad.net/ceilometer/+bug/138160015:29
cdentwill push the fix pronto15:29
eglynncdent: thank you sir!15:29
cdentugh15:29
cdentI think I've just found another bug15:29
cdent(of the same sort)15:30
eglynndarn!15:30
cdent(this is _exactly_ why I used full data sets in the tests for the similar ironic stuff, rather than the smaller samples used in this code)15:30
* cdent will remember to stick more strongly to guns in the future15:30
cdentthe second issue is here:15:31
eglynncdent: yep ... and feel free to modify the tests in your patch to the style you'd in mind in the initial reviews15:31
cdenthttps://github.com/openstack/ceilometer/blob/0820c95f0d335e978a92f5b65848d51623e4df78/ceilometer/ipmi/pollsters/sensor.py#L5615:32
cdentthat exception will blow out the entire collection of samples from the current ipmi call15:32
cdentinstead of just skipping one that is bad15:32
cdent(the original issue is at line 6515:32
eglynncrapski :(15:34
eglynnwell at least we're finding these issue now before releasing packages15:34
cdentI think the right fix is log instead of raise15:34
eglynn(though of course would have been better to have gotten the fixes into RC3)15:34
eglynnagree15:35
*** isviridov is now known as isviridov_away15:39
*** packet has joined #openstack-ceilometer15:46
cdentjd__: are you expecting/hoping everyone to migrate to gnocchi as soon as it is ready? (re your comment on https://review.openstack.org/#/c/128391/ )15:47
jd__cdent: well the point is to finish and integrate completely during Kilo and obsolete the current sample scheme15:50
jd__cdent: so I don't see putting efforts into that BP during Kilo being a smart idea15:50
jd__though the idea itself sounds good to me15:51
cdentbut presumably the old way will have to have the usual long deprecation cycle15:51
jd__agreed15:51
cdentand people's existing installations might like some expiration granularity as they struggle into the future15:52
jd__but is it worthwile adding features in K for something deprecating in L?15:52
* cdent doesn't know, thus the query15:52
jd__well15:52
jd__best thing is that it's going to be deprecated in K15:52
jd__so "here's K with new features for samples that are now being deprecated"15:52
jd__O_O15:53
cdentAssuming things go to plan, I guess, yeah.15:54
*** ildikov has quit IRC15:56
*** _cjones_ has joined #openstack-ceilometer16:03
eglynncdent: re. severity of https://bugs.launchpad.net/ceilometer/+bug/1381600 ... High d'ya agree?16:05
cdentyes16:05
openstackgerritChris Dent proposed a change to openstack/ceilometer: Handle poorly formed individual sensor readings  https://review.openstack.org/12869416:23
cdentthere go eglynn16:23
eglynncdent: thank you sir!16:23
*** admin0 has quit IRC16:24
eglynnllu, jd__, gordc, sileht, DinaBelova, _nadya__: I'd appreciate quick eyes on https://review.openstack.org/128694 if you got a minute16:28
eglynnthanks! :)16:28
cdenteglynn: the rootwrap changes appear to be okay16:33
eglynncdent: nice, thanks for confirming16:33
gordccdent: how do you feel about inheriting TestTemperatureSensorPollster rather than TestPollsterBase16:37
*** yatin has joined #openstack-ceilometer16:38
cdentgordc: I just went with replicating the pattern that was already there16:38
gordccdent: good enough for me. +A16:38
cdent(which was  fairly verbose test per thingie)16:38
gordci'm very firm with my opinions. :)16:38
*** sbfox has joined #openstack-ceilometer16:39
cdentIn another context I'd be full of despair and hate for those tests.16:39
*** safchain has quit IRC16:39
cdentBut I figured it was better just to get it done16:39
_nadya__cdent: only one question: shouldn't we add logging in case of error or it's not useful for chunk lost?16:39
gordccdent: fair enoug16:40
openstackgerritgordon chung proposed a change to openstack/ceilometer: add script to generate test event data  https://review.openstack.org/12844516:40
cdentAs I said in the commit message _nadya_ there are a _lot_ skipped chunks, logging them would be extremely verbose16:40
cdentand it is an expected condition16:40
cdentwhat wasn't expected was that the condition should make everything die16:40
_nadya__cdent: I see, sorry I missed that. Ok! Agreed with approval :)16:41
cdent:)16:41
*** safchain has joined #openstack-ceilometer16:41
*** sbfox has quit IRC16:43
*** sbfox has joined #openstack-ceilometer16:43
mspreitzI have a stupid question about the CLI command `ceilometer resource-list -q <QUERY>`.  What does it mean?  I mean, how is the QUERY relevant?16:44
eglynnmspreitz: it allows you to constrain the query, e.g. ceilometer resource-list -q "project=PROJECT_ID"16:45
mspreitzbut what exactly does the constraint mean?  Is it a filter on Samples?  If so, how does that affect the answer to my request for resources?16:46
mspreitzeglynn: I suspect the answer is this: `ceilometer resource-list -q QUERY` returns all the resources mentioned in Samples that mach the QUERY.  Have I got it right?16:48
mspreitzs/mach/match/16:48
eglynnmspreitz: interesting question :) ... it actually depends on the storage backend16:49
mspreitzeglynn: ruh roh!16:50
eglynnmspreitz: lemme fill out some background to explain it better16:50
mspreitzeglynn: great, thanks!16:51
eglynnmspreitz: so originally all resources queries where essentially queries over the samples in the mongodb case16:51
eglynnmspreitz: this was because the resource representation includes a first and last sample timestamp16:52
eglynnmspreitz: but the performance absolutely sucked, as the entire set of samples had to be walked to satisfy the query16:52
eglynnmspreitz: so I rationalized that approach with https://github.com/openstack/ceilometer/commit/7b4d4d44650bbe10225084b3ab5155f70ebebb9516:53
*** amalagon has joined #openstack-ceilometer16:53
eglynnmspreitz: the commit message describes the compromise approach taken16:53
eglynnmspreitz: i.e. general resource queries ==> satisfied from the much smaller resources collection16:54
eglynnmspreitz: i.e. time-constrained resource queries ==> satisfied from the meter collection (i.e. the raw samples)16:54
mspreitzyep, just read it16:54
*** amalagon_ has joined #openstack-ceilometer16:55
mspreitzbut it sounds like that change only affects implementation, not the behavior delivered to clients16:55
mspreitzDoes that change affect the results delivered to clients?16:56
mspreitzeglynn: that looks like an implementation change not an API change, not a behavior change.  Is that right?16:57
eglynnthe first and last timestamps samples may not be set accurately in the results for older resources16:57
mspreitzeglynn: OK.  But in terms of the results to queries for resources, this change is a no-op, right?16:58
eglynnmspreitz: by older resources, I mean resources that existed in the metering store prior to that patch16:58
*** amalagon has quit IRC16:58
eglynnmspreitz: the same resources are returned, if that's what you mean16:58
mspreitzeglynn: or maybe those timestamps are in the query results, I guess that is why you bring it up16:58
mspreitzeglynn: yes, my concern here is for which resources are returned16:59
eglynnmspreitz: yes, the first & last timestamps are included representation of those resources, that's why I mentioned it16:59
*** amalagon_ has quit IRC16:59
eglynnmspreitz: but the set of resources returned would be essentially the same16:59
mspreitzeglynn: so, if I understand correctly, `ceilometer resource-list -q QUERY` returns a set of resources that does not depend on the backend, although the timestamp bounds in those resources may depend on the backend17:00
eglynnmspreitz: yes17:00
mspreitzeglynn: Let me ask further which resources are returned.  Is it exactly those for which there is at least one Sample that matches the query?17:00
eglynnmspreitz: conceptually yes ... but as I said earlier, the query is satisified from a different collection in reality (in most cases)17:02
mspreitzeglynn: but that different collection is maintained automatically and consistently, right?17:02
eglynnmspreitz: yes, it's updated as each sample is inserted17:02
mspreitzOK, thanks.17:03
mspreitzeglynn: next question: is this semantics described in any document?17:03
*** _nadya__ has quit IRC17:03
eglynnmspreitz: to that level of detail? no, I'd suspect not17:04
*** amalagon has joined #openstack-ceilometer17:04
*** julim has quit IRC17:04
openstackgerritA change was merged to openstack/ceilometer: Avoid clobbering existing class definition  https://review.openstack.org/12836717:04
mspreitzeglynn: Ugh.  Next question.  I am having trouble writing a resource-list query that filters on meter name.  Can you give me an example that works?17:04
openstackgerritA change was merged to openstack/ceilometer: Clarify deprecation comment to be accurate  https://review.openstack.org/12835317:04
mspreitzeglynn: `ceilometer --debug sample-list -m my-favorite-meter` reveals that in the API, the term is "counter_name" rather than "meter name".  But queries on that give me 40017:06
mspreitzas do queries on counter, meter, and meter_name17:06
eglynnmspreitz: one sec17:06
*** yatin has quit IRC17:08
*** harlowja_away is now known as harlowja17:15
mspreitzeglynn: are you still there?17:16
*** _nadya_ has joined #openstack-ceilometer17:16
eglynnmspreitz: yes17:16
*** _cjones_ has quit IRC17:17
*** _cjones_ has joined #openstack-ceilometer17:17
eglynnmspreitz: sorry I had to finish something else17:19
*** _nadya_ has quit IRC17:19
eglynnmspreitz: k, so there are certain fields that be used to constrain queries on certain endpoints17:19
eglynnmspreitz: for resources the list includes 'project', 'user', 'resource' & 'source'17:20
mspreitzeglynn: is the list for resources documented anywhere?17:20
eglynnmspreitz: it appears in the error message IIRC17:20
mspreitzYes!  DEBUG (client) RESP BODY: {"error_message": {"debuginfo": null, "faultcode": "Client", "faultstring": "Unknown argument: \"counter_name\": unrecognized field in query: [<Query u'counter_name' eq u'network.services.lb.member' >], valid keys: ['end_timestamp', 'end_timestamp_op', 'metaquery', 'pagination', 'project', 'resource', 'source', 'start_timestamp', 'start_timestamp_op', 'user']"}}17:21
mspreitzwhat's that metaquery thing?17:22
eglynnquery on the metadata17:23
mspreitzeglynn: here is an example Sample I got from `ceilometer --degut sample-list`: {"counter_name": "network.services.lb.member", "user_id": null, "resource_id": "5c2caff6-1ad9-4806-9455-98ab524d6fc7", "timestamp": "2014-10-15T03:55:37.842352", "recorded_at": "2014-10-15T03:55:37.858280", "message_id": "1f93506c-541f-11e4-b0d0-fa6363248f18", "source": "openstack", "counter_unit": "member", "counter_volume": 0.0, "project_id"17:24
mspreitzdang, truncated by freenode17:25
mspreitz"project_id": "ba0ddcea2e0744a3aafe3ff26fd6d292", "resource_metadata": {"status": "INACTIVE", "status_description": "None", "weight": "1", "admin_state_up": "True", "pool_id": "c7931134-37f5-430b-aabb-b3953f3ad83a", "address": "10.0.0.212", "protocol_port": "80"}, "counter_type": "gauge"}17:25
mspreitzthat's the rest17:25
mspreitzeglynn: so metaquery would be a query over the "resource_metadata" part?17:26
eglynnyep17:27
*** changbl has joined #openstack-ceilometer17:30
*** r-daneel has joined #openstack-ceilometer17:37
*** Ala has joined #openstack-ceilometer17:40
*** julim has joined #openstack-ceilometer17:42
*** changbl has quit IRC17:43
*** Ala has quit IRC17:48
*** _nadya_ has joined #openstack-ceilometer17:49
mspreitzeglynn: this is very surprising.  You are telling me that in `ceilometer resource-list -q QUERY`, the query can NOT discriminate on counter_name (AKA meter name) and the query can NOT discriminate based on counter_volume.  Have I got that right?17:49
eglynnmspreitz: yes, this is a query over the resources as I explained above, as opposed to the samples, so it cannot be constrained by the sample volume17:54
eglynnmspreitz: there might be dozens of different meters associated with a resource and potentially million of different sample volumes17:55
mspreitzeglynn: OK, so the QUERY in `ceilometer resource-list -q QUERY` is semantically constrained to be about only the Resources, not their associated Samples17:55
eglynnmspreitz: yes, modulo the issue that I mentioned right at the very start (around first & last samples timestamps)17:56
mspreitzeglynn: `ceilometer sample-list -m METER -q QUERY`, OTOH, does get to look at Samples17:56
mspreitzeglynn: right, understand about the time bound subtlety17:57
eglynnmspreitz: yes, sample-list looks at the samples, that's its purpose17:57
* cdent dines17:58
mspreitzeglynn: however, `ceilometer sample-list -m METER -q QUERY` can not do something like GROUP BY, so I can not use it to find resources that have Sample meeting some criterion.   I have to fetch all the matching Samples and then reduce the data myself17:58
*** _nadya_ has quit IRC17:58
mspreitzeglynn: have I got that right?18:01
*** admin0 has joined #openstack-ceilometer18:01
eglynnmspreitz: one sec18:02
eglynnmspreitz: sorry, yeah, groupby is intended for the statistics API as there's aggregation going on18:09
eglynnmspreitz: whereas sample-lists reports the raw samples (i.e. no aggregation)18:09
eglynnmspreitz: see http://docs.openstack.org/developer/ceilometer/webapi/v2.html18:09
eglynnmspreitz: ... I'm gonna have to drop off v. soon, after 7pm here18:10
amalagonjd__:  looks like the response_dict thing was indeed a bug: https://bugs.launchpad.net/swift/+bug/138130418:10
jd__amalagon: well done!18:11
amalagon:)18:11
mspreitzeglynn: OK, let me try two quick questions18:12
mspreitzeglynn: First, for the CLI, how do I put a datatype in a query?  I mean, if I have to compare with something that is not a string?18:13
mspreitzeglynn: Second, does Ceilometer have any way to query for the stats aggregated over all of a period that the client passes in as a paremeter to the API operation I am looking for?18:13
mspreitzOkay, anybody can answer.18:15
mspreitzWhat do I write on the command line to, e.g., compare counter_volume with a number?18:15
*** jergerber has quit IRC18:18
eglynnmspreitz: I'll be back in a hour, I'll answer your questions then18:20
eglynn(dinner time ... eating)18:20
*** eglynn is now known as eglynn-afk18:20
mspreitzeglynn: thanks18:20
*** admin0 has quit IRC18:20
*** _nadya_ has joined #openstack-ceilometer18:30
*** _nadya_ has quit IRC18:39
*** mspreitz has quit IRC18:42
*** jmanko has joined #openstack-ceilometer18:52
*** _nadya_ has joined #openstack-ceilometer18:52
*** mikehn has quit IRC18:52
*** mikehn_ has joined #openstack-ceilometer18:52
*** jmank has quit IRC18:53
*** packet has quit IRC18:55
*** amalagon has quit IRC18:55
*** packet has joined #openstack-ceilometer18:57
*** jaypipes has quit IRC18:57
*** mspreitz has joined #openstack-ceilometer19:01
*** _cjones_ has quit IRC19:02
*** _cjones_ has joined #openstack-ceilometer19:03
*** drjones has joined #openstack-ceilometer19:06
*** _cjones_ has quit IRC19:06
*** tongli has joined #openstack-ceilometer19:09
*** jaypipes has joined #openstack-ceilometer19:11
*** _nadya_ has quit IRC19:14
*** admin0 has joined #openstack-ceilometer19:21
eglynn-afkmspreitz: I'm back (briefly)19:21
*** eglynn-afk is now known as eglynn19:21
*** admin0 has quit IRC19:21
eglynnmspreitz: "how do I put a datatype in a query" ==> just prefix the value with type::19:22
eglynnwhere type is integer, float, string, boolean etc.19:22
eglynne.g. ceilometer sample-list -m instance -q  'metadata.status==string::shutoff'19:22
mspreitzso, e.g., counter_volume<integer:0.119:22
mspreitzeglynn: right?19:22
eglynnno19:22
mspreitzoh no19:22
mspreitzits double colon instead of single19:23
eglynnyep19:23
mspreitzthanks19:23
mspreitzgot it19:23
eglynnmspreitz: "does Ceilometer have any way to query for the stats aggregated over all of a period" ==> yep the -q can be timestamp-bounded to constrain to a period19:23
eglynne.g. ceilometer statistics -m cpu_util -q 'timestamp>START;timestamp<=END'19:23
eglynnwhere START, END are in ISO8601 format19:24
mspreitzeglynn: what if I want one answer, covering the whole period, not many answers, each for a distinct subperiod?19:24
eglynnmspreitz: the -p option controls the sub-period lenght19:24
mspreitzeglynn: alignment is my question19:24
eglynnmspreitz: defaults to the entire duration if missing19:25
*** admin0 has joined #openstack-ceilometer19:25
*** admin0 has quit IRC19:25
mspreitzeglynn: in the statistics operation, with -p N, are boundaries implicitly set to multiples of N from 1970.0, or multiple of N from time of query op, or ... ?19:26
*** cdent has quit IRC19:28
eglynnmspreitz: well if I understand your question ...19:29
eglynnmspreitz: ... the duration of the selected samples (as constrained by the query condition) are split from the start of that duration by period19:29
eglynnmspreitz: ... NOT from 197019:29
eglynnmspreitz: ... in particular we don't report on periods for which we've no datapoints19:30
mspreitzeglynn: I confuse period and duration.  Suppose I say `ceilometer statistics -m METER -p N`.  That gives me records, each one covering a range of time [start, end); I am speaking of the queried time, not the data found.  Successive starts are separated by a multiple of N.  Each start is a multiple of N added to or subtracted from some baseline.  What is the baseline?19:32
eglynnmspreitz: ok, let me tie down terminology to lift the confusion19:33
eglynnmspreitz: lets say "span" is the entire range of the timestamps covered by the query19:33
eglynnmspreitz: lets say "period" is the individual time-buckets into which these datapoints are aggregated19:34
*** safchain has quit IRC19:34
mspreitza simple experiment reminded me of duration vs period19:34
mspreitzand I got span19:35
eglynnmspreitz: and finally lets save "duration" in our new, clearer terminology to mean the range of timestamps of actual datapoints that fall *with* each period19:35
mspreitzright19:35
mspreitzso my question is about the periods19:35
mspreitzeach starts at some multiple of N added to or subtracted from <what>?19:35
eglynnmspreitz: so if I submit a query like this -q 'timestamp>START;timestamp<=END'19:35
eglynnmspreitz: that selects all match datapoints between START and END19:36
mspreitzthat is the span19:36
eglynnmspreitz: exactly, that's the span19:36
eglynnmspreitz: the span is then spilt into periods19:36
eglynnmspreitz: the split occurs from the start of the span19:36
mspreitzgreat, thanks19:36
mspreitzBTW, how are the periods set when the query does not include START?19:37
eglynnmspreitz: first matching sample timestamp19:37
mspreitzOK, thanks19:37
mspreitzIs this documented anywhere?19:38
eglynnmspreitz: not as completely as it should be, though patch as always are welcome :)19:38
eglynnmspreitz: any follow-up questions, catch me on IRC tomorrow19:38
eglynnmspreitz: (my TZ is GMT, getting late now, so dropping off shortly)19:39
mspreitzceilometer sample-list -m cpu_util -q "counter_volume<float::0.1"19:39
mspreitzeglynn: gave me 40019:39
mspreitzHTTP error code 40019:39
mspreitzeglynn: thanks for all the help so far19:40
mspreitzeglynn: ceilometer sample-list -m cpu_util -q "counter_volume<integer::1" also fails w HTTP return code 40019:42
mspreitzalso no good for real or int19:42
openstackgerritA change was merged to openstack/ceilometer: refactor hbase storage code  https://review.openstack.org/12759119:43
eglynnmspreitz: as I thought I explained earlier, each query has a list fields that it can be constrained on19:43
eglynnmspreitz: list *of fields19:44
eglynnmspreitz: user, project, resource etc. and then free-form metadata query19:44
eglynnmspreitz: volume is not in that list19:44
mspreitzeglynn: oh, right, sorry, I forgot to ask for the list for sample-list19:44
eglynnmspreitz: just look at the error message, I believe it lists them19:45
mspreitzeglynn: yep, it's there19:45
mspreitzeglynn: so I can not use `ceilometer sample-list` to find samples with extreme values.  And I can not use `ceilometer resource-list` to find resource with samples from a given meter.19:47
mspreitzeglynn: there there any plan to enable such things?19:47
openstackgerritA change was merged to openstack/ceilometer: Handle poorly formed individual sensor readings  https://review.openstack.org/12869419:47
mspreitzs/there there/are there/19:47
*** cdent has joined #openstack-ceilometer19:48
*** eglynn has quit IRC19:49
*** eglynn has joined #openstack-ceilometer19:51
*** cdent has quit IRC19:53
eglynnmspreitz: ack & ack to your first two assertions19:53
eglynnmspreitz: no specific plans ... but if you have a requirement for these, the usual approach would be file a bug19:54
eglynnmspreitz: and as always, patches are welcome :)19:54
mspreitzeglynn: OK, thanks.  Maybe just one final question.  If I were to attempt to add the doc that I asked about but is not there, where should it go?19:54
eglynnmspreitz: here's where the API doc should be expanded https://github.com/openstack/ceilometer/blob/master/doc/source/webapi/v2.rst19:56
mspreitzeglynn: thank you VERY much19:57
eglynnmspreitz: np!19:57
*** eglynn has quit IRC19:57
*** ifarkas has quit IRC19:57
*** amalagon has joined #openstack-ceilometer19:57
*** tongli has quit IRC20:10
*** tongli has joined #openstack-ceilometer20:11
*** nellysmitt has quit IRC20:37
*** nellysmitt has joined #openstack-ceilometer20:38
*** nellysmitt has quit IRC20:42
*** promulo_ has joined #openstack-ceilometer20:55
*** flwang has joined #openstack-ceilometer21:22
*** mspreitz has quit IRC21:23
*** r-daneel has quit IRC21:28
*** tongli has quit IRC21:32
*** gordc has quit IRC21:41
*** drjones has quit IRC21:48
*** _cjones_ has joined #openstack-ceilometer21:49
*** safchain has joined #openstack-ceilometer21:52
*** _cjones_ has quit IRC21:53
*** packet has quit IRC21:58
*** _cjones_ has joined #openstack-ceilometer22:01
*** asalkeld has joined #openstack-ceilometer22:12
*** sbfox1 has joined #openstack-ceilometer22:14
flwanggreetings, is there any known issue about running tox against icehouse branch?22:16
*** sbfox has quit IRC22:16
flwangI always get this error "Non-zero exit code (2) from test listing."22:16
*** sbfox has joined #openstack-ceilometer22:17
*** sbfox1 has quit IRC22:19
*** jmatthews has quit IRC22:25
*** alexpilotti has quit IRC22:32
*** ryanpetrello has quit IRC22:34
*** ryanpetrello has joined #openstack-ceilometer22:35
openstackgerritSrinivas Sakhamuri proposed a change to openstack/ceilometer: Allow collector service database connection retry  https://review.openstack.org/12712822:50
*** asalkeld has quit IRC22:56
*** promulo_ has quit IRC23:01
*** rbak has quit IRC23:04
*** BernardVDW has joined #openstack-ceilometer23:10
*** asalkeld has joined #openstack-ceilometer23:13
*** _cjones_ has quit IRC23:24
*** _cjones_ has joined #openstack-ceilometer23:24
*** drjones has joined #openstack-ceilometer23:26
*** _cjones_ has quit IRC23:29
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ceilometer: Updated from global requirements  https://review.openstack.org/12775823:40
*** jaypipes has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!