| *** packet has quit IRC | 00:12 | |
| *** amalagon has joined #openstack-ceilometer | 00:20 | |
| *** fnaval has quit IRC | 00:24 | |
| *** david-lyle is now known as david-lyle_afk | 00:31 | |
| *** fnaval has joined #openstack-ceilometer | 00:43 | |
| openstackgerrit | Srinivas Sakhamuri proposed openstack/ceilometer: Internal error with period overflow https://review.openstack.org/134415 | 00:56 |
|---|---|---|
| *** asalkeld has joined #openstack-ceilometer | 00:57 | |
| *** david-lyle_afk has quit IRC | 01:08 | |
| *** Viswanath has joined #openstack-ceilometer | 01:09 | |
| *** Viswanath has quit IRC | 01:12 | |
| *** rwsu has quit IRC | 01:18 | |
| *** ssakhamuri has quit IRC | 01:25 | |
| *** nosnos has joined #openstack-ceilometer | 01:43 | |
| *** Yanyanhu has joined #openstack-ceilometer | 01:58 | |
| *** _cjones_ has quit IRC | 02:23 | |
| *** mc__ has joined #openstack-ceilometer | 03:28 | |
| *** nosnos has quit IRC | 03:30 | |
| *** nosnos has joined #openstack-ceilometer | 03:30 | |
| *** nosnos has quit IRC | 03:35 | |
| mc__ | not clear to me: network.incoming.bytes.rate uses 1024bytes or 1000bytes as unit, when talking about usage of SI-Unit? | 03:38 |
| mc__ | @ http://docs.openstack.org/developer/ceilometer/measurements.html | 03:39 |
| *** Longgeek has joined #openstack-ceilometer | 03:39 | |
| *** jd__ has quit IRC | 03:44 | |
| *** jd__ has joined #openstack-ceilometer | 03:44 | |
| *** SergeyLukjanov has quit IRC | 03:45 | |
| *** Longgeek has quit IRC | 03:45 | |
| *** d0ugal has quit IRC | 03:45 | |
| *** SergeyLukjanov has joined #openstack-ceilometer | 03:47 | |
| *** d0ugal has joined #openstack-ceilometer | 03:48 | |
| *** d0ugal is now known as Guest32556 | 03:48 | |
| *** ssakhamuri has joined #openstack-ceilometer | 03:52 | |
| *** ryanpetrello has joined #openstack-ceilometer | 04:06 | |
| *** ryanpetrello has quit IRC | 04:13 | |
| *** ryanpetrello has joined #openstack-ceilometer | 04:18 | |
| *** nosnos has joined #openstack-ceilometer | 04:27 | |
| *** ryanpetrello has quit IRC | 04:28 | |
| *** mc__ has quit IRC | 04:31 | |
| openstackgerrit | justinsb proposed openstack/ceilometer: Support for Cassandra https://review.openstack.org/132382 | 04:35 |
| *** yatin has joined #openstack-ceilometer | 04:42 | |
| *** deepthi has joined #openstack-ceilometer | 04:42 | |
| *** Longgeek has joined #openstack-ceilometer | 04:59 | |
| *** amalagon has quit IRC | 05:23 | |
| *** _cjones_ has joined #openstack-ceilometer | 05:24 | |
| *** mc__ has joined #openstack-ceilometer | 05:26 | |
| *** _cjones_ has quit IRC | 05:28 | |
| *** amalagon has joined #openstack-ceilometer | 05:44 | |
| *** ishant has joined #openstack-ceilometer | 05:55 | |
| *** exploreshaifali has joined #openstack-ceilometer | 06:02 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ceilometer: Imported Translations from Transifex https://review.openstack.org/132619 | 06:10 |
| openstackgerrit | Kai Qiang Wu proposed openstack/ceilometer: Initializing a longer resource id in DB2 nosql backend https://review.openstack.org/131947 | 06:26 |
| *** _nadya_ has joined #openstack-ceilometer | 06:40 | |
| mc__ | Hey, I would like to know how ceilometer count memory / memory.usage. Does it include virtual and swap memory inside this VM or just count available memory part? | 06:45 |
| openstackgerrit | justinsb proposed openstack/ceilometer: Support for Cassandra https://review.openstack.org/132382 | 06:47 |
| *** ssakhamuri has quit IRC | 06:56 | |
| *** ildikov has quit IRC | 06:56 | |
| *** yatin has quit IRC | 07:01 | |
| *** k4n0 has joined #openstack-ceilometer | 07:08 | |
| *** exploreshaifali has quit IRC | 07:22 | |
| *** ssakhamuri has joined #openstack-ceilometer | 07:36 | |
| *** Longgeek has quit IRC | 07:37 | |
| *** Longgeek has joined #openstack-ceilometer | 07:38 | |
| *** ildikov has joined #openstack-ceilometer | 07:46 | |
| *** nosnos has quit IRC | 08:00 | |
| *** exploreshaifali has joined #openstack-ceilometer | 08:00 | |
| *** nosnos has joined #openstack-ceilometer | 08:03 | |
| *** ala_ has joined #openstack-ceilometer | 08:10 | |
| *** _nadya_ has quit IRC | 08:17 | |
| *** llu has quit IRC | 08:18 | |
| *** llu has joined #openstack-ceilometer | 08:18 | |
| *** ifarkas has joined #openstack-ceilometer | 08:18 | |
| eglynn | mc__: we report both memory and memory.usage meters | 08:36 |
| eglynn | mc__: "memory" is the total RAM allocated to the VM | 08:36 |
| eglynn | mc__: "memory.usage" is the difference between the available and unused numbers in the stats reported by libvirt (assuming that's the inspector you're using) | 08:37 |
| eglynn | mc__: not the caveat in http://docs.openstack.org/developer/ceilometer/measurements.html#compute-nova on the libvirt/qemu versions required | 08:38 |
| eglynn | *note the caveat | 08:38 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: carbonara: add full option to fetch() https://review.openstack.org/133431 | 08:50 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: carbonara: fix the default fetch() behavior https://review.openstack.org/133353 | 08:50 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: carbonara: fix archive back window https://review.openstack.org/131487 | 08:50 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: storage: do not include to_timestamp in the range https://review.openstack.org/133433 | 08:50 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: storage: expose full argument in get_measure() https://review.openstack.org/133432 | 08:50 |
| *** ishant has quit IRC | 08:50 | |
| openstackgerrit | Merged stackforge/gnocchi: Remove assertEqual when request method has params for it https://review.openstack.org/134316 | 08:51 |
| *** ishant has joined #openstack-ceilometer | 08:51 | |
| *** gordc has joined #openstack-ceilometer | 08:55 | |
| *** _nadya_ has joined #openstack-ceilometer | 08:57 | |
| *** safchain has joined #openstack-ceilometer | 08:58 | |
| *** mc__ has quit IRC | 09:13 | |
| *** _nadya_ has quit IRC | 09:15 | |
| openstackgerrit | Merged openstack/ceilometer: Add encoding to keys in compute_signature https://review.openstack.org/133707 | 09:16 |
| *** exploreshaifali has quit IRC | 09:20 | |
| deepthi | eglynn, On similar lines, what about memory usage statistics of the physical host ? This is not reported currently, so any plans for the same ? | 09:24 |
| eglynn | deepthi: you could use SNMP polling to gather per-host data | 09:25 |
| eglynn | deepthi: however the problem currently with SNMP polling in ceilometer is the discovery of the SNMP daemons to poll | 09:26 |
| eglynn | deepthi: these can be hardcoded into the pipeline.yaml resources attribute | 09:26 |
| eglynn | deepthi: but that's not reasonable for anything but a very small and static deployment | 09:26 |
| deepthi | eglynn, aha | 09:26 |
| eglynn | deepthi: in the special case of tripleO deployed hosts, we support auto-discovery via the nova API | 09:27 |
| eglynn | lsmola: ^^^ is there docco for that discovery extension? | 09:27 |
| eglynn | https://github.com/openstack/ceilometer/blob/master/ceilometer/hardware/discovery.py | 09:27 |
| deepthi | eglynn, thank you so much for the info. Shall try to explore the same via SNMP agents. | 09:28 |
| eglynn | deepthi: np! | 09:28 |
| lsmola | eglynn: not that I know of, would be worth to create one | 09:29 |
| lsmola | eglynn: :-) | 09:29 |
| lsmola | deepthi: this is the current list of SNMP stats we are collecting https://github.com/openstack/ceilometer/blob/master/ceilometer/hardware/inspector/snmp.py#L167 | 09:32 |
| lsmola | deepthi: it's kind of hardcoded here now | 09:32 |
| lsmola | deepthi: but we should extract it to yaml conf, so you can define it per deployment, that should happen in K | 09:33 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: carbonara: add full option to fetch() https://review.openstack.org/133431 | 09:34 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: carbonara: fix the default fetch() behavior https://review.openstack.org/133353 | 09:34 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: carbonara: fix archive back window https://review.openstack.org/131487 | 09:34 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: storage: do not include to_timestamp in the range https://review.openstack.org/133433 | 09:34 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: storage: expose full argument in get_measure() https://review.openstack.org/133432 | 09:34 |
| deepthi | lsmola, I see all the memory stats I require, so tweaking the yaml file to enable collecting the same should resolve my issue.. right ? | 09:35 |
| lsmola | deepthi: for TripleO I am using this pipeline https://github.com/openstack/tripleo-image-elements/blob/master/elements/ceilometer-undercloud-config/os-apply-config/etc/ceilometer/pipeline.yaml | 09:36 |
| lsmola | deepthi: you can define there what you want to collect, we collect all with "hardware.*" | 09:36 |
| lsmola | deepthi: it's also example of how to use the discovery and the new arithmetic transformers | 09:37 |
| deepthi | lsmola, aha nice. Thanks for the pointers. Will use this as a reference and try out the same :-) | 09:37 |
| openstackgerrit | gordon chung proposed openstack/python-ceilometerclient: sync with oslo and use oslo.i18n https://review.openstack.org/126639 | 09:41 |
| *** Yanyanhu has quit IRC | 09:52 | |
| *** nellysmitt has joined #openstack-ceilometer | 09:54 | |
| *** nellysmitt has quit IRC | 09:59 | |
| *** alexpilotti has joined #openstack-ceilometer | 10:01 | |
| *** cdent has joined #openstack-ceilometer | 10:03 | |
| openstackgerrit | Romain Soufflet proposed stackforge/gnocchi: Add get_entity method in indexer https://review.openstack.org/134485 | 10:03 |
| *** Guest32556 is now known as d0ugal | 10:14 | |
| *** d0ugal is now known as Guest92455 | 10:14 | |
| *** Guest92455 is now known as d0ugal | 10:16 | |
| *** d0ugal has quit IRC | 10:16 | |
| *** d0ugal has joined #openstack-ceilometer | 10:16 | |
| *** ssakhamuri has quit IRC | 10:16 | |
| *** cdent has quit IRC | 10:18 | |
| *** cdent has joined #openstack-ceilometer | 10:30 | |
| *** nosnos has quit IRC | 10:43 | |
| *** nosnos has joined #openstack-ceilometer | 10:51 | |
| *** asalkeld_ has joined #openstack-ceilometer | 10:52 | |
| *** IvanBerezovskiy has joined #openstack-ceilometer | 10:52 | |
| *** asalkeld has quit IRC | 10:53 | |
| *** cmyster has quit IRC | 11:02 | |
| *** exploreshaifali has joined #openstack-ceilometer | 11:07 | |
| *** cmyster has joined #openstack-ceilometer | 11:10 | |
| *** cmyster has joined #openstack-ceilometer | 11:10 | |
| openstackgerrit | Romain Soufflet proposed stackforge/gnocchi: Add get_entity method in indexer https://review.openstack.org/134485 | 11:11 |
| *** Longgeek has quit IRC | 11:13 | |
| *** Longgeek has joined #openstack-ceilometer | 11:21 | |
| *** nellysmitt has joined #openstack-ceilometer | 11:26 | |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: rest: validate archive policies definitions https://review.openstack.org/134507 | 11:29 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: rest: allow to have infinite retention in policies https://review.openstack.org/134508 | 11:29 |
| *** nellysmitt has quit IRC | 11:31 | |
| *** zqfan has joined #openstack-ceilometer | 11:39 | |
| *** ishant has quit IRC | 11:51 | |
| *** ishant has joined #openstack-ceilometer | 11:52 | |
| *** asalkeld_ has quit IRC | 12:03 | |
| jd__ | eglynn: so InfluxDB drops all data points by default after aggregation? I thought it would keep them for ever. Or is it a limitation when running the continuous query? | 12:06 |
| jd__ | not sure I'm clear :) | 12:07 |
| eglynn | jd__: in influx, the rentention and the aggregation (=downsampling in their lingo) are controlled by two separate mechanisms | 12:08 |
| eglynn | jd__: so continuous queries drive the aggregation, but don't discard the original full-res datapoints | 12:08 |
| eglynn | jd__: whereas shard-space deletion controls the rentention period | 12:08 |
| eglynn | jd__: so generally the full-res data can be kept around for as long as you want it to be, independent of the downsampling logic | 12:09 |
| jd__ | hum | 12:10 |
| jd__ | so it sounds to me they shouldn't have any kind of limitation | 12:10 |
| jd__ | if they never drop any point, adding a point back in time should trigger the recomputing of the aggregates | 12:10 |
| eglynn | jd__: the specific influx problem I was talking about in https://review.openstack.org/#/c/131487/5/gnocchi/carbonara.py is that once the continuous query runs, slightly "late" datapoints for the last period are ignored | 12:10 |
| jd__ | thought I guess the choise of having a pull based system (continuous query) and not a push system disallow that | 12:11 |
| eglynn | jd__: yeah, exactly the recompute is never triggered currently in influx | 12:11 |
| jd__ | http://www.cartoonbrew.com/wp-content/uploads/nelson-muntz.jpg bad design :p | 12:11 |
| eglynn | jd__: FYI the relevant issue in the influx tracker https://github.com/influxdb/influxdb/issues/510 | 12:12 |
| jd__ | eglynn: so "back window" wouldn't make any sense in InfluxDB, e.g. it is 0 now and in the future it would be +∞ ? | 12:13 |
| eglynn | jd__: ... this one also relevant https://github.com/influxdb/influxdb/issues/479 | 12:13 |
| eglynn | jd__: well, it could be any finite value <∞ once those issues are fixed | 12:14 |
| eglynn | jd__: so currently it can't be >0, as the aggregate values are never recomputed | 12:15 |
| jd__ | what would be the point to have something < ∞ since anyway everything is kept? | 12:15 |
| eglynn | jd__: well, if it was set <∞, we wouldn't keep everything | 12:15 |
| *** _nadya_ has joined #openstack-ceilometer | 12:16 | |
| eglynn | jd__: instead of keeping it forever (the default in InfluxDB) we'd use the shard-space deletion on the full-res timeseries to expire points older than the (block_size * back_window) from the last period boundary | 12:17 |
| jd__ | got it | 12:18 |
| jd__ | I like that plan :) | 12:18 |
| eglynn | jd__: so one other related point ... IIUC, while influx allows you to expire these older data, it just doesn't gaurantee that the discard is done eagerly | 12:18 |
| eglynn | jd__: i.e. there may be a degree of fuzziness in that it wait until an entire "shard" of data can be dropped at once | 12:19 |
| jd__ | is that true for the result of continuous query also? | 12:19 |
| eglynn | "shard" meaning something smaller than the normal DB sense of the word | 12:19 |
| eglynn | no, I think the continuous queries are designed to run eagerly | 12:19 |
| eglynn | (i.e. when the period switches) | 12:20 |
| *** _nadya_ has quit IRC | 12:20 | |
| jd__ | ok so that wouldn't be a problem for now as we never returned data from non-continous-query | 12:21 |
| gordc | cdent: out of curiosity, does Rally run on bare-metal machines? | 12:22 |
| cdent | can you be a bit more specific about "run" gordc ? | 12:22 |
| jd__ | does it have legs? | 12:22 |
| cdent | When I've used it is with a bare-metal hosted devstack | 12:23 |
| gordc | ... multiple legs. | 12:23 |
| *** cmyster has quit IRC | 12:23 | |
| gordc | cdent: if we gate on it, i assume it's being benchmarked against some devstack on a vm? | 12:23 |
| gordc | cdent: i don't know much about rally tbh. | 12:24 |
| eglynn | gordc: as a CI job, it runs on normal CI virt nodes IIUC | 12:24 |
| eglynn | gordc: but boris-42 also runs periodic jobs on dedicated baremetal IIUC | 12:24 |
| cdent | gordc: are you concerned about the unpredictable latency that vms intorduce? | 12:24 |
| *** exploreshaifali has quit IRC | 12:24 | |
| gordc | eglynn: i see... can you really effectively performance test against something on a virt node | 12:25 |
| gordc | cdent: exactly. | 12:25 |
| eglynn | gordc: yeah, exactly ... see discussion here https://review.openstack.org/#/c/129922/7/specs/kilo/rally-check-gate.rst | 12:25 |
| cdent | If you look at my rally spec gordc there's a fair bit of discussion about that | 12:25 |
| cdent | jinz | 12:25 |
| cdent | x | 12:25 |
| gordc | cdent: eglynn: cool cool. as you can tell, i read the title and that's as far as i got. :) | 12:25 |
| cdent | to be honest/fair/whatever my enthusiasm for having the gate job waned quite a bit as a result of that discussion | 12:26 |
| eglynn | gordc: yeah, so the key problems are the noisy neighbors and the perf penalty seen on RAX versus HP test clouds | 12:27 |
| cdent | largely because it revealed that the rally team is planning to keep historical data on all "integrated" projects themselves and that stuff is more interesting to me | 12:27 |
| eglynn | (or HP versus RAX, can't remember which was the slower) | 12:27 |
| cdent | the per patch data is perhaps useful for flagging up "oh shit!"s | 12:27 |
| gordc | cdent: yeah, i'd assume that gate would eat dirt once we near any milestone | 12:27 |
| eglynn | cdent: yeah, exactly the point I was getting at with the surfacing the trend-line comments | 12:28 |
| *** ishant has quit IRC | 12:28 | |
| eglynn | gordc: yeap, the proposal to only fail on p99 or p99.9 means it would need to be a catostrophic "oh shit" moment | 12:29 |
| eglynn | ... e.g. sleep(3600) inadvertantly added to record_metering_data ;) | 12:29 |
| cdent | I reckon we have three options: | 12:30 |
| eglynn | any "normal" perf regression is unlikely to top out over p99.9 (with all the outliers in the mix anyway) | 12:30 |
| cdent | go with the plan as spec | 12:30 |
| cdent | go with spec - voting/sla | 12:30 |
| cdent | drop spec | 12:30 |
| cdent | s/-/minus/ # for clarity | 12:30 |
| eglynn | "go with spec - voting/sla" seems like a decent plan to me, as I doubt the worth of the pass/fail criteria | 12:31 |
| *** deepthi has quit IRC | 12:31 | |
| *** yatin has joined #openstack-ceilometer | 12:31 | |
| gordc | cdent: yeah, i'm not sure how much value this is going to be honestly but i guess we can give it a try and drop it if we find it's giving us nonsense. | 12:32 |
| *** yatin has quit IRC | 12:32 | |
| gordc | i've no idea what voting/sla means.lol | 12:32 |
| cdent | I'm struggling to recall the who/what was the inspiration for making the spec. I feel like someone asked me to, but dunno | 12:32 |
| cdent | gordc: if you get deeper in the spec it might make sense | 12:33 |
| *** nosnos has quit IRC | 12:33 | |
| *** ishant has joined #openstack-ceilometer | 12:33 | |
| *** cmyster has joined #openstack-ceilometer | 12:34 | |
| *** cmyster has joined #openstack-ceilometer | 12:34 | |
| * gordc reading comments | 12:34 | |
| *** yatin has joined #openstack-ceilometer | 12:37 | |
| cdent | eglynn: has anyone ever said you're passive aggressive? | 12:43 |
| gordc | cdent: i assume this is somewhere in the spec, but i take it tests only against sql backends? | 12:43 |
| * cdent points at comment on review 133476 | 12:43 | |
| eglynn | cdent: huh? | 12:43 |
| cdent | eglynn: I'm half kidding, but if you are, it's in the good way | 12:44 |
| gordc | lol passive aggressive... in the good way | 12:44 |
| cdent | gordc: that's not stated and I guess that's a good question | 12:45 |
| cdent | probably needs to be clarified somehow | 12:45 |
| cdent | it doesn't _have_ to be just sql | 12:45 |
| eglynn | gordc: well both mongo and sqla would be useful | 12:45 |
| gordc | eglynn: agreed. wasn't sure if i missed it in spec | 12:46 |
| *** _nadya_ has joined #openstack-ceilometer | 12:47 | |
| eglynn | gordc: yeah, I don't remember that point being called out explicitly TBH | 12:49 |
| cdent | it's not mentioned, should be | 12:49 |
| cdent | please leave a comment and when I do the revision to wipe out the sla and I'll add in some words about it | 12:49 |
| cdent | I'm not sure how it would be done (yet). | 12:50 |
| cdent | That's one of the annoyances of this spec process: its seem to operate against iteration driven discovery, so much of it is mental | 12:50 |
| gordc | cdent: added backend item... and another comment about changes by infra | 12:51 |
| cdent | thanks | 12:51 |
| eglynn | the idea IIUC was to swing the pendulum back from kicking the can down the road on all the gnarly issues | 12:53 |
| cdent | "i just added this comment randomly somehwere" | 12:54 |
| eglynn | ... instead promote more upfront consideration/discussion | 12:54 |
| cdent | that assumes we can see the gnarly issues | 12:54 |
| *** exploreshaifali has joined #openstack-ceilometer | 12:54 | |
| cdent | I'm not opposed to the spec process directly. | 12:55 |
| eglynn | yep, in this case I think we could see some at least, as per the noisy neighbor discussion | 12:55 |
| cdent | I do think, however, that encourages people to bite off too much in one spec. | 12:55 |
| cdent | And not necessarily the author doing that. | 12:55 |
| eglynn | but in other yeah, the doing reveals a lot more | 12:55 |
| eglynn | but in other *cases yeah, the doing reveals a lot more | 12:55 |
| cdent | What seems to happen is: spec gets written and someone else sees it and is like "Oh, you're in there, can you also do X?" | 12:55 |
| eglynn | e.g. that was the case certainly for the central agent scale-out | 12:55 |
| gordc | cdent: it's (slightly) better than before... where we just had bps in launchpad purgatory. | 12:56 |
| * cdent wants more small more often | 12:56 | |
| cdent | gordc: yeah, that sounds like it was probably horrible | 12:56 |
| gordc | cdent: tried to clean up launchpad bps recently... i've no idea what the hell is active, clean, abandoned. | 12:57 |
| cdent | launchpad is chaos | 12:57 |
| eglynn | after the experience with one cycle of the specs process, I think we need to use our collective judgement a bit more | 12:57 |
| eglynn | (as discussed in the weekly meeting yesterday) | 12:57 |
| openstackgerrit | justinsb proposed openstack/ceilometer: Support for Cassandra https://review.openstack.org/132382 | 12:58 |
| eglynn | i.e. judge what needs a fully detailed spec review and what doesn't | 12:58 |
| cdent | I think we need to put less in ceilometer. For example that ^ (cassandra). Why is that not an external optional package? | 12:59 |
| eglynn | yes, we've discussed that very point in relation to 3rd party CI of non-core things that can't be CI'd easily upstream | 13:00 |
| eglynn | e.g. VMware inspector, IPMI Intel node manager stuff | 13:00 |
| cdent | Then again I think nearly everything should be an externally packaged plugin | 13:00 |
| * cdent nods | 13:00 | |
| eglynn | move out of tree, and get maintainers to put arms-length CI in place | 13:01 |
| cdent | That would be _very_ good for ensuring and enhancing boundaries | 13:01 |
| cdent | and good boundaries make for good testability | 13:01 |
| *** russellb is now known as rustlebee | 13:02 | |
| eglynn | .... it's casual-nick Friday :) | 13:03 |
| * eglynn needs a more casual nick | 13:04 | |
| * eglynn searches for clues to self-knowledge in http://en.wikipedia.org/wiki/Passive-aggressive_behavior#In_the_workplace | 13:04 | |
| cdent | A.t some point soon my lovely wife will return and I'll have to take the car for its mot | 13:05 |
| cdent | ha! | 13:05 |
| cdent | You do understand which comment I'm talking about, don't you? | 13:05 |
| eglynn | "... dishonest, backstabbing saboteurs behind the scenes" LOL :) | 13:05 |
| eglynn | yeah I think so | 13:05 |
| eglynn | small, self-contained patch ... or? | 13:06 |
| cdent | passive aggressive is probably the wrong term | 13:06 |
| cdent | "should be non-controversial" | 13:06 |
| cdent | cut off objections at the pass | 13:06 |
| *** jmatthew_ has joined #openstack-ceilometer | 13:07 | |
| eglynn | yeah, the repetition of same ... lazy copy'n'paste on my part | 13:07 |
| openstackgerrit | justinsb proposed openstack/ceilometer: Support for Cassandra https://review.openstack.org/132382 | 13:07 |
| *** ishant has quit IRC | 13:08 | |
| eglynn | right-o ... mahlzeit | 13:09 |
| * cdent clones packstack | 13:09 | |
| *** eglynn is now known as eglynn-lunch | 13:10 | |
| *** ryanpetrello has joined #openstack-ceilometer | 13:20 | |
| *** zqfan has quit IRC | 13:22 | |
| *** yatin has quit IRC | 13:25 | |
| *** Longgeek has quit IRC | 13:28 | |
| *** ryanpetrello has quit IRC | 13:30 | |
| *** _nadya_ has quit IRC | 13:31 | |
| *** ryanpetrello has joined #openstack-ceilometer | 13:33 | |
| *** ildikov has quit IRC | 13:36 | |
| *** zqfan has joined #openstack-ceilometer | 13:41 | |
| *** jmatthew_ has quit IRC | 13:44 | |
| openstackgerrit | ZhiQiang Fan proposed openstack/python-ceilometerclient: Fix timeout argument not treated as integer https://review.openstack.org/134109 | 14:17 |
| eglynn-lunch | jd__: time for a (hopefully) quick/simple carbonara question? | 14:30 |
| eglynn-lunch | jd__: ... just checking my understanding re. the purpose of the various TimeSerie classes | 14:30 |
| eglynn-lunch | BoundTimeSeries: the full-resolution buffer of incoming raw datapoints (one per entity) | 14:30 |
| eglynn-lunch | AggregatedTimeSeries: downsampled timeseries for a single granularity/aggregation-function pair supported by an entity | 14:31 |
| eglynn-lunch | TimeSerieArchive: collection of AggregatedTimeSeries for all granularities supported an entity (for a particular aggregation function) | 14:31 |
| eglynn-lunch | jd__: am I on-track or off-piste? ^^^ | 14:32 |
| *** eglynn-lunch is now known as eglynn | 14:32 | |
| *** _nadya_ has joined #openstack-ceilometer | 14:34 | |
| *** alexpilotti has quit IRC | 14:39 | |
| *** alexpilotti has joined #openstack-ceilometer | 14:40 | |
| eglynn | folks, last call for http://doodle.com/4dutdtq3m7kztysd for anyone who hasn't already voted and is interested in learning from the pasta-maker | 14:43 |
| eglynn | _nadya_: ^^^ poll on gnocchi bootstrap hangout if you're interested | 14:43 |
| _nadya_ | eglynn: ok! thanks | 14:45 |
| *** ryanpetrello has quit IRC | 14:49 | |
| openstackgerrit | Srinivas Sakhamuri proposed openstack/ceilometer: Internal error with period overflow https://review.openstack.org/134415 | 14:50 |
| openstackgerrit | Julien Danjou proposed openstack/ceilometer: Switch to oslo.concurrency https://review.openstack.org/134552 | 14:51 |
| eglynn | jd__: looks like 1500UTC Monday is our winner for the gnocchi hangout | 14:56 |
| *** dnalezyt has quit IRC | 14:58 | |
| *** ddieterly has joined #openstack-ceilometer | 15:03 | |
| *** ddieterly has quit IRC | 15:05 | |
| *** ddieterly has joined #openstack-ceilometer | 15:05 | |
| *** ddieterly has quit IRC | 15:06 | |
| *** ddieterly has joined #openstack-ceilometer | 15:06 | |
| *** rbak has joined #openstack-ceilometer | 15:07 | |
| *** fnaval has quit IRC | 15:09 | |
| *** ryanpetrello has joined #openstack-ceilometer | 15:12 | |
| jd__ | eglynn: ok let me know once you close the poll | 15:15 |
| jd__ | eglynn: sorry missed your question, so: | 15:16 |
| jd__ | BoundTimeSeries: the full-resolution buffer of incoming raw datapoints (one per entity) -> yes + it's bound to a certain number of block (back window etc) so the size is limited | 15:16 |
| jd__ | TimeSerieArchive: yes + it has a BoundTimeSeries to feed the AggregatedTimeSeries with raw data | 15:17 |
| *** ryanpetrello has quit IRC | 15:17 | |
| openstackgerrit | Julien Danjou proposed openstack/ceilometer: Switch to oslo.concurrency https://review.openstack.org/134552 | 15:18 |
| eglynn | jd__: cool, thanks! | 15:19 |
| *** _nadya_ has quit IRC | 15:19 | |
| eglynn | jd__: ... reason I doubted my understanding was the use of resample in BoundTimeSeries._first_block_timestamp() in the back window patch | 15:19 |
| openstackgerrit | Julien Danjou proposed openstack/ceilometer: Remove module not really used by Ceilometer https://review.openstack.org/134563 | 15:20 |
| jd__ | eglynn: ok, I hope it's clearer :) | 15:20 |
| jd__ | my Gnocchi patches start to pile up | 15:21 |
| eglynn | jd__: yeah, so I'm in review mode for the rest of today, hoping to get thru' them all | 15:21 |
| jd__ | thanks eglynn | 15:22 |
| eglynn | jd__: TBH I'm still a bit flumoxed by the BoundTimeSeries being a full-res buffer, yet resampling with the default how='mean' aggregation function | 15:22 |
| *** _nadya_ has joined #openstack-ceilometer | 15:22 | |
| eglynn | jd__: I feel I'm missing something really obvious on that point | 15:22 |
| jd__ | eglynn: it doesn't store the resampling | 15:22 |
| *** _nadya_ has quit IRC | 15:23 | |
| jd__ | eglynn: it's just used to have the boundaries timestamp of the aggregation | 15:23 |
| jd__ | it's dropped on the floor then | 15:23 |
| eglynn | yeap, I was missing something really obvious :) | 15:23 |
| jd__ | I guess that was that? :) | 15:23 |
| eglynn | yeap :) | 15:23 |
| jd__ | coolio | 15:24 |
| eglynn | thanks! | 15:24 |
| *** _nadya_ has joined #openstack-ceilometer | 15:24 | |
| eglynn | jd__: BTW just closed that poll (looks like every who's likely to vote has done so) | 15:24 |
| jd__ | eglynn: ok I'm gonna create an Hangout event | 15:24 |
| eglynn | jd__: coolness, thank you sir! | 15:25 |
| *** cdent has quit IRC | 15:31 | |
| jd__ | eglynn: https://plus.google.com/events/cts3l8lmi7333friiii4rurr9no | 15:31 |
| eglynn | jd__: thanks! | 15:31 |
| *** fnaval has joined #openstack-ceilometer | 15:36 | |
| *** fnaval_ has joined #openstack-ceilometer | 15:37 | |
| *** fnaval has quit IRC | 15:37 | |
| openstackgerrit | Merged stackforge/gnocchi: carbonara: fix archive back window https://review.openstack.org/131487 | 15:41 |
| openstackgerrit | Merged stackforge/gnocchi: carbonara: fix the default fetch() behavior https://review.openstack.org/133353 | 15:41 |
| idegtiarov | Hi! Folks what do you think about patch https://review.openstack.org/#/c/132988/ it is seems to be reviewed enough, and could be landed? | 15:43 |
| eglynn | amalagon: can you respond to jd__'s last comment in https://review.openstack.org/#/c/133431/2/gnocchi/carbonara.py ? | 15:43 |
| amalagon | eglynn: responding now :) | 15:43 |
| eglynn | amalagon: i.e. "If that's not needed I can also drop this patch entirely" | 15:43 |
| eglynn | amalagon: cool, thanks! | 15:44 |
| eglynn | idegtiarov: looking now | 15:44 |
| idegtiarov | eglynn: Thank you sir! | 15:44 |
| eglynn | idegtiarov: looks good, other than a small test coverage suggestion and doc update | 15:58 |
| *** cmyster has quit IRC | 15:58 | |
| *** zqfan has quit IRC | 15:58 | |
| idegtiarov | eglynn: will improve, thank you for fast review | 15:59 |
| eglynn | idegtiarov: thank you sir! | 15:59 |
| idegtiarov | eglynn: :) | 15:59 |
| eglynn | amalagon: thanks for the update on gerrit, agree that basing computations on that full-res buffer is problematic | 16:02 |
| eglynn | amalagon: ... since the quantum of data available totally depends on the current time, and where that falls within the coarsest period for the entity | 16:03 |
| amalagon | eglynn: yeah :/ | 16:03 |
| amalagon | eglynn: I totally misunderstood the buffer window though at first | 16:03 |
| *** packet has joined #openstack-ceilometer | 16:03 | |
| eglynn | amalagon: good to explore the idea in any case, though | 16:03 |
| amalagon | thought it was anchored on the last timepoint | 16:03 |
| amalagon | eglynn: I'll go back to aggregating on finest granularity data | 16:03 |
| amalagon | and hopefully the 0sec granularity option in archive policy will become available | 16:04 |
| eglynn | amalagon: cool, that makes sense | 16:05 |
| amalagon | eglynn: stupid question alert: I was wondering if it made more sense to load the plugins with something other than stevedore | 16:06 |
| eglynn | amalagon: is stevedore providing problematic for you? | 16:06 |
| eglynn | amalagon: e.g. the entry_points issue you saw earlier in the week | 16:06 |
| amalagon | eglynn: no, that's working now, but it seems like extra work to me that each custom aggregate function has to be specified in the setup.cfg file | 16:07 |
| eglynn | amalagon: since we already use stevedore to load the storage drivers, seems logical to follow that model for custom aggregations also | 16:07 |
| amalagon | eglynn: and I was reading that using abc, one can find out all concrete implementations of the abstract CustomAggregator | 16:08 |
| dhellmann | amalagon: discovering subclasses only works if the code is already imported, so you can't use that to find modules you need to import | 16:08 |
| amalagon | ah | 16:08 |
| dhellmann | it works by looking at the __subclasses__ attribute of the class | 16:09 |
| eglynn | amalagon: also I'm not sure that users would be writing their own custom aggregators (i.e. would need to be modifying the setup.cfg and rerunning setup.py) | 16:09 |
| amalagon | eglynn: that's true too | 16:10 |
| dhellmann | if they have their own aggregators, they would go in a separate package anyway | 16:10 |
| amalagon | dhellmann: good point | 16:10 |
| eglynn | dhellmann: so a completely separate entry_points.txt to drive the loading? | 16:10 |
| amalagon | alright, I'm convinced - sticking with stevedore | 16:11 |
| dhellmann | eglynn: right -- one key benefit of entry points is that they use a different namespace from the python package namespace, so the code can live somewhere else and still be discoverable | 16:11 |
| eglynn | dhellmann: a-ha, coolness | 16:11 |
| dhellmann | in practice we tend to use the same string for both packages and ep namespaces, but that's a convention not a rule | 16:12 |
| openstackgerrit | Srinivas Sakhamuri proposed openstack/ceilometer: Internal error with period overflow https://review.openstack.org/134415 | 16:17 |
| *** Longgeek has joined #openstack-ceilometer | 16:25 | |
| gordc | jd__: does watch_join_group only for zookeeper in tooz? | 16:27 |
| jd__ | gordc: memcached and redis supports it too | 16:27 |
| gordc | jd__: guess i'm doing it wrong then. | 16:28 |
| jd__ | gordc: got some code? | 16:28 |
| *** ala_ has quit IRC | 16:29 | |
| gordc | jd__: one sec. i'll copy/paste it somewhere. | 16:29 |
| gordc | jd__: http://paste.openstack.org/show/133208/ | 16:30 |
| gordc | it reuses the current coordination code in ceilometer. seems like the callback never gets triggered | 16:30 |
| gordc | although, based on subset extracted by second worker, it does seem to know that there are multiple agents | 16:31 |
| jd__ | gordc: do you have another node joining the group? | 16:31 |
| jd__ | gordc: you need to call run_watchers() once in a while | 16:32 |
| *** Longgeek has quit IRC | 16:32 | |
| jd__ | gordc: that's the one really calling the callback functions | 16:32 |
| gordc | jd__: ok. i'll take a look at run_watchers | 16:32 |
| gordc | i have two agents which should be in same group since i'm using static group_id | 16:32 |
| eglynn | gordc: would cdent's inspector tool be any use to you for checking if the agents are members of the expected group? | 16:34 |
| eglynn | https://review.openstack.org/#/c/127271/5/ceilometer/cmd/coordination_inspect.py | 16:34 |
| eglynn | DinaBelova: https://wiki.gnome.org/OutreachProgramForWomen/2014/DecemberMarch#Accepted_Participants \o/ | 16:36 |
| eglynn | "Nelly Kuznetsova (nellysmitt), Voronezh, Russia / Lier, Belgium - Ceilometer - Dina Belova" | 16:36 |
| *** _cjones_ has joined #openstack-ceilometer | 16:36 | |
| eglynn | ^^^ presumably to be working on a ceph driver for gnocchi | 16:36 |
| gordc | eglynn: good suggestion. i'm pretty sure it's in same group since the second agent does pick up a smaller set than the first. | 16:36 |
| gordc | jd__: cool. it seems to pick up join_group when i add run_watchers... doesn't see leave_group... i'll look into how it cleans up group | 16:41 |
| jd__ | gordc: it can misses event if join/leave is done between 2 runs of run_watchers() | 16:42 |
| jd__ | gordc: basically it just does a diff between the group state between each run_watchers() call for memcached or redis | 16:42 |
| gordc | jd__: i have run_watchers sync'd with heartbeat so it's every second | 16:44 |
| gordc | jd__: yeah, way more members register in tooz than real agents running. i'm assuming i'm not cleaning it up properly. | 16:46 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: Remove custom 204 response code setting https://review.openstack.org/134599 | 16:47 |
| openstackgerrit | Julien Danjou proposed openstack/ceilometer: Remove module not really used by Ceilometer https://review.openstack.org/134563 | 16:50 |
| openstackgerrit | Julien Danjou proposed stackforge/gnocchi: storage: do not include to_timestamp in the range https://review.openstack.org/133433 | 16:52 |
| *** exploreshaifali has quit IRC | 16:54 | |
| *** _nadya_ has quit IRC | 16:54 | |
| *** ifarkas has quit IRC | 16:56 | |
| gordc | jd__: cool leave_group missing on stop. /me pats myself on the back. | 16:58 |
| jd__ | hum | 16:59 |
| jd__ | gordc: or it sounds like it should be implicittely done by tooz | 16:59 |
| gordc | jd__: yeah maybe... it's definitely triggering callback when it cleans group of dead members. | 17:01 |
| gordc | definitely not* | 17:01 |
| jd__ | right | 17:01 |
| jd__ | which backend are you using? | 17:02 |
| gordc | memcache | 17:02 |
| jd__ | gordc: would you have enough bravey to write a unit test in tooz at least? | 17:02 |
| jd__ | should be pretty straight forward, I could fix it then | 17:02 |
| gordc | jd__: now or monday when i'm back in montreal? | 17:02 |
| gordc | i have different answers depending on when. :) | 17:03 |
| jd__ | gordc: whatever suits you, or at least report a bug or something :) | 17:03 |
| jd__ | just don't forget about it | 17:03 |
| gordc | ok. i'll open a bug for now | 17:03 |
| gordc | https://bugs.launchpad.net/python-tooz | 17:04 |
| gordc | i'm assuming that's the right project | 17:04 |
| openstackgerrit | Merged stackforge/gnocchi: rest: validate archive policies definitions https://review.openstack.org/134507 | 17:05 |
| jd__ | gordc: sure | 17:06 |
| *** david-lyle has joined #openstack-ceilometer | 17:10 | |
| *** ryanpetrello has joined #openstack-ceilometer | 17:15 | |
| eglynn | amalagon: so IIUC https://review.openstack.org/133433 should do away with the need to subtract 1msec off the right-side timestamp in your MA calculation? | 17:18 |
| amalagon | eglynn: hmm I hadn't thought about that.. | 17:19 |
| amalagon | eglynn: but my feeling is that I would still need to subtract off the msec? Because although that makes the retrieved measure non-inclusive of the stop, I still am slicing over small windows within the retrieved measure and have to make those small windows non-inclusive of the right endpoint | 17:21 |
| eglynn | amalagon: actually yep, you're right, ignore me ... I'm talking rubbish again :) | 17:21 |
| *** IvanBerezovskiy has left #openstack-ceilometer | 17:22 | |
| amalagon | eglynn: ha no | 17:22 |
| *** _nadya_ has joined #openstack-ceilometer | 17:24 | |
| eglynn | amalagon: since this was abandoned https://review.openstack.org/#/c/104415/30/gnocchi/aggregates/rolling_statistics.py | 17:25 |
| eglynn | amalagon: presumably there's another patch on the way to partner up with https://review.openstack.org/133388 ? | 17:25 |
| amalagon | eglynn: yep, absolutely | 17:25 |
| eglynn | amalagon: coolness :) | 17:26 |
| amalagon | I am rebasing https://review.openstack.org/#/c/133388/ at the moment | 17:26 |
| *** _nadya_ has quit IRC | 17:26 | |
| *** _nadya_ has joined #openstack-ceilometer | 17:27 | |
| *** _cjones_ has quit IRC | 17:29 | |
| *** _cjones_ has joined #openstack-ceilometer | 17:29 | |
| openstackgerrit | Merged stackforge/gnocchi: storage: do not include to_timestamp in the range https://review.openstack.org/133433 | 17:29 |
| openstackgerrit | Merged stackforge/gnocchi: Remove custom 204 response code setting https://review.openstack.org/134599 | 17:29 |
| *** _nadya_ has quit IRC | 17:34 | |
| *** harlowja has joined #openstack-ceilometer | 17:35 | |
| *** prad has joined #openstack-ceilometer | 17:37 | |
| *** harlowja has quit IRC | 17:37 | |
| *** harlowja has joined #openstack-ceilometer | 17:37 | |
| *** rwsu has joined #openstack-ceilometer | 17:38 | |
| *** _nadya_ has joined #openstack-ceilometer | 17:49 | |
| *** _cjones_ has quit IRC | 17:52 | |
| openstackgerrit | Merged stackforge/gnocchi: storage: multi-thread add_measure in Carbonara based drivers https://review.openstack.org/132681 | 17:55 |
| *** _cjones_ has joined #openstack-ceilometer | 17:55 | |
| *** ryanpetrello has quit IRC | 17:59 | |
| openstackgerrit | Merged stackforge/gnocchi: Allow to filter resources on NULL values https://review.openstack.org/131055 | 18:02 |
| *** ryanpetrello has joined #openstack-ceilometer | 18:06 | |
| *** _nadya_ has quit IRC | 18:07 | |
| openstackgerrit | Ana Malagon proposed stackforge/gnocchi: extension for moving aggregates https://review.openstack.org/133388 | 18:09 |
| *** amalagon has quit IRC | 18:15 | |
| *** gordc has quit IRC | 18:34 | |
| *** safchain has quit IRC | 18:36 | |
| openstackgerrit | Eoghan Glynn proposed stackforge/gnocchi: Minor readability imporvements to carbonara https://review.openstack.org/134621 | 18:40 |
| *** alexpilotti has quit IRC | 18:46 | |
| *** ryanpetrello has quit IRC | 18:47 | |
| *** amalagon has joined #openstack-ceilometer | 18:51 | |
| *** ryanpetrello has joined #openstack-ceilometer | 18:52 | |
| *** harlowja is now known as harlowja_away | 18:58 | |
| *** nellysmitt has joined #openstack-ceilometer | 19:10 | |
| *** harlowja_away is now known as harlowja | 19:11 | |
| *** nellysmitt has quit IRC | 19:14 | |
| *** ryanpetrello has quit IRC | 19:17 | |
| *** ryanpetrello has joined #openstack-ceilometer | 19:22 | |
| *** joshw42 has quit IRC | 19:34 | |
| *** exploreshaifali has joined #openstack-ceilometer | 19:36 | |
| *** prad has quit IRC | 19:39 | |
| *** imormo has joined #openstack-ceilometer | 19:45 | |
| *** amalagon has quit IRC | 19:50 | |
| *** ddieterly has quit IRC | 19:51 | |
| *** ddieterly has joined #openstack-ceilometer | 19:52 | |
| *** packet has quit IRC | 20:09 | |
| *** eglynn has quit IRC | 20:10 | |
| *** nellysmitt has joined #openstack-ceilometer | 20:12 | |
| *** _cjones_ has quit IRC | 20:15 | |
| *** ildikov has joined #openstack-ceilometer | 20:16 | |
| *** ryanpetrello has quit IRC | 20:18 | |
| *** amalagon has joined #openstack-ceilometer | 20:21 | |
| openstackgerrit | Ana Malagon proposed stackforge/gnocchi: extension for moving aggregates https://review.openstack.org/133388 | 20:26 |
| *** eglynn has joined #openstack-ceilometer | 20:28 | |
| *** promulo has joined #openstack-ceilometer | 20:31 | |
| *** promulo__ has quit IRC | 20:32 | |
| *** promulo has quit IRC | 20:35 | |
| *** promulo has joined #openstack-ceilometer | 20:35 | |
| *** _nadya_ has joined #openstack-ceilometer | 20:35 | |
| *** promulo has quit IRC | 20:42 | |
| *** imormo has quit IRC | 20:53 | |
| *** _nadya_ has quit IRC | 20:55 | |
| *** _cjones_ has joined #openstack-ceilometer | 21:00 | |
| *** ryanpetrello has joined #openstack-ceilometer | 21:00 | |
| *** rustlebee is now known as russellb | 21:03 | |
| *** ildikov has quit IRC | 21:08 | |
| *** alexpilotti has joined #openstack-ceilometer | 21:19 | |
| *** ryanpetrello has quit IRC | 21:22 | |
| *** ryanpetrello has joined #openstack-ceilometer | 21:25 | |
| *** ryanpetrello has quit IRC | 21:42 | |
| *** bklei has joined #openstack-ceilometer | 22:05 | |
| *** bklei has quit IRC | 22:09 | |
| *** bklei has joined #openstack-ceilometer | 22:10 | |
| openstackgerrit | Ana Malagon proposed stackforge/gnocchi: extension for moving aggregates https://review.openstack.org/133388 | 22:20 |
| *** bklei has quit IRC | 22:38 | |
| *** bklei has joined #openstack-ceilometer | 22:39 | |
| *** amalagon has quit IRC | 22:42 | |
| *** Viswanath has joined #openstack-ceilometer | 22:42 | |
| *** bklei has quit IRC | 22:44 | |
| *** Viswanath has quit IRC | 22:45 | |
| *** exploreshaifali has quit IRC | 22:59 | |
| *** _cjones_ has quit IRC | 23:09 | |
| *** _cjones_ has joined #openstack-ceilometer | 23:09 | |
| *** eglynn has quit IRC | 23:14 | |
| *** _nadya_ has joined #openstack-ceilometer | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
