Wednesday, 2015-12-09

*** openstack has joined #openstack-telemetry00:53
pleia2well, momentarily you should00:53
pleia2there we go!00:53
*** pleia2 has left #openstack-telemetry00:53
*** poi has quit IRC01:15
*** diogogmt has joined #openstack-telemetry01:21
*** ljxiash has joined #openstack-telemetry01:24
*** ljxiash_ has joined #openstack-telemetry01:24
*** ljxiash__ has joined #openstack-telemetry01:25
*** ljxias___ has joined #openstack-telemetry01:25
*** ljxia____ has joined #openstack-telemetry01:26
*** ljxia____ has quit IRC01:27
*** ljxiash has quit IRC01:28
*** ljxiash has joined #openstack-telemetry01:28
*** ljxiash__ has quit IRC01:29
*** ljxiash_ has quit IRC01:29
*** ljxias___ has quit IRC01:30
*** _nadya_ has joined #openstack-telemetry01:32
*** _nadya_ has quit IRC01:37
*** ari___ has quit IRC01:40
*** caishan has joined #openstack-telemetry01:40
*** Liuqing has joined #openstack-telemetry01:48
*** Liuqing has quit IRC01:58
openstackgerrithardik proposed openstack/ceilometer: Delete python bytecode before every test run.  https://review.openstack.org/25504102:02
*** leecalcote has joined #openstack-telemetry02:03
*** leecalcote has quit IRC02:12
openstackgerrityuntongjin proposed openstack/ceilometer: event to sample publisher  https://review.openstack.org/22710602:40
*** thorst has joined #openstack-telemetry02:40
*** prashantD has quit IRC02:46
*** diogogmt has quit IRC02:53
*** sanjana has joined #openstack-telemetry03:22
*** links has joined #openstack-telemetry03:24
*** thorst has quit IRC03:25
*** thorst has joined #openstack-telemetry03:43
*** thorst has quit IRC03:44
*** thorst has joined #openstack-telemetry03:45
*** alejandrito has quit IRC03:52
*** fawadkhaliq has joined #openstack-telemetry03:53
*** thorst has quit IRC03:54
*** fawadkhaliq has quit IRC04:00
*** links has quit IRC04:03
openstackgerritMerged openstack/gnocchi: statsd have some required configuration options  https://review.openstack.org/24862104:30
openstackgerritMerged openstack/gnocchi: devstack: add gnocchi-statsd  https://review.openstack.org/25226604:34
*** links has joined #openstack-telemetry04:38
*** fawadkhaliq has joined #openstack-telemetry04:45
*** fawadkhaliq has quit IRC04:47
*** thorst has joined #openstack-telemetry04:52
*** sanjana has quit IRC04:52
*** thorst has quit IRC04:58
*** boris-42_ has quit IRC05:03
*** ljxiash has quit IRC05:14
*** ljxiash has joined #openstack-telemetry05:14
*** ljxiash has quit IRC05:16
*** ljxiash has joined #openstack-telemetry05:16
*** fawadkhaliq has joined #openstack-telemetry05:33
*** _nadya_ has joined #openstack-telemetry05:48
*** _nadya_ has quit IRC05:53
*** thorst has joined #openstack-telemetry05:56
*** thorst has quit IRC06:04
*** ljxiash has quit IRC06:05
*** Chaozhe has joined #openstack-telemetry06:05
*** chaozhechen_ has joined #openstack-telemetry06:05
*** ljxiash has joined #openstack-telemetry06:05
*** caishan_ has joined #openstack-telemetry06:06
*** caishan has quit IRC06:06
*** ljxiash has quit IRC06:08
*** ljxiash_ has joined #openstack-telemetry06:08
*** chaozhechen__ has joined #openstack-telemetry06:08
openstackgerritzhanghanqun proposed openstack/gnocchi: Allow the volume display_name field to be null  https://review.openstack.org/25466506:09
*** chaozhechen_ has quit IRC06:10
*** Chaozhe has quit IRC06:10
*** Chaozhe has joined #openstack-telemetry06:11
*** logan- has quit IRC06:24
*** ljxiash_ has quit IRC06:29
*** ljxiash has joined #openstack-telemetry06:29
*** jaypipes has joined #openstack-telemetry06:31
*** yprokule has joined #openstack-telemetry06:32
*** ljxiash has quit IRC06:34
*** ljxiash has joined #openstack-telemetry06:37
*** _nadya_ has joined #openstack-telemetry06:42
*** _nadya_ has quit IRC06:47
*** PSS has joined #openstack-telemetry06:51
PSSi have cloned the python-ceilometerclient repository from github.  When i tru to run the tox command, i get the ERROR:   py34: InterpreterNotFound: python3.4 , ERROR:   pypy: InterpreterNotFound: pypy06:53
PSSwhile py27: commands succeeded and pep8: commands succeeded06:53
PSShow can i resolve the above error06:53
openstackgerritzhanghanqun proposed openstack/gnocchi: Allow the volume display_name field to be null  https://review.openstack.org/25466507:01
*** thorst has joined #openstack-telemetry07:01
openstackgerritOpenStack Proposal Bot proposed openstack/ceilometer: Updated from global requirements  https://review.openstack.org/25389007:04
*** shardy has joined #openstack-telemetry07:06
*** thorst has quit IRC07:09
*** heha37 has joined #openstack-telemetry07:16
*** heha37 has quit IRC07:17
*** zqfan_travel has joined #openstack-telemetry07:20
*** rcernin has joined #openstack-telemetry07:20
*** _nadya_ has joined #openstack-telemetry07:21
*** zqfan_travel is now known as zqfan_AFK07:24
*** boris-42_ has joined #openstack-telemetry07:31
*** cdent has joined #openstack-telemetry07:50
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: fix cache hash logic  https://review.openstack.org/25457407:55
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: use gnocchiclient instead of requests  https://review.openstack.org/23753807:55
*** pece has joined #openstack-telemetry07:56
*** pece has quit IRC08:04
*** thorst has joined #openstack-telemetry08:06
*** Chaozhe has quit IRC08:09
*** chaozhechen_ has joined #openstack-telemetry08:10
*** chaozhechen__ has quit IRC08:10
*** Chaozhe has joined #openstack-telemetry08:13
*** thorst has quit IRC08:14
*** belmoreira has joined #openstack-telemetry08:15
*** ljxiash has quit IRC08:23
*** ljxiash has joined #openstack-telemetry08:23
*** _nadya_ has quit IRC08:28
*** _nadya_ has joined #openstack-telemetry08:29
*** _nadya_ has quit IRC08:29
*** fawadkhaliq has quit IRC08:32
*** r-mibu has joined #openstack-telemetry08:38
*** shardy has quit IRC08:42
*** shardy has joined #openstack-telemetry08:43
*** fawadkhaliq has joined #openstack-telemetry08:48
*** shardy has quit IRC08:49
*** fawadkhaliq has quit IRC08:49
*** shardy has joined #openstack-telemetry08:51
*** safchain has joined #openstack-telemetry08:57
*** yassine__ has joined #openstack-telemetry09:01
*** Chaozhe has quit IRC09:01
*** chaozhechen_ has quit IRC09:01
*** Chaozhe has joined #openstack-telemetry09:03
*** chaozhechen_ has joined #openstack-telemetry09:03
*** openstackstatus has quit IRC09:05
*** openstack has joined #openstack-telemetry09:08
*** thorst has joined #openstack-telemetry09:12
*** ljxiash has quit IRC09:12
*** ljxiash has joined #openstack-telemetry09:13
*** ljxiash has quit IRC09:17
*** thorst has quit IRC09:18
openstackgerrithardik proposed openstack/gnocchi: Delete python bytecode before every test run.  https://review.openstack.org/25514709:20
*** ljxiash has joined #openstack-telemetry09:21
openstackgerritsanjana proposed openstack/python-ceilometerclient: Restructuring Comment in Python-Ceilometerclient(alarms.py) Related-Bug: https://bugs.launchpad.net/python-ceilometerclient/+bug/1523866  https://review.openstack.org/25514909:23
openstackLaunchpad bug 1523866 in python-ceilometerclient "Unclear comment in CeilometerClient module" [Low,Triaged] - Assigned to sanjana (sanjana)09:23
*** openstackgerrit has quit IRC09:32
*** openstackgerrit has joined #openstack-telemetry09:33
openstackgerritJulien Danjou proposed openstack/gnocchi: storage: round back from_timestamp in get_measures()  https://review.openstack.org/25252509:34
openstackgerritJulien Danjou proposed openstack/gnocchi: storage/carbonara: simplify tooz locking  https://review.openstack.org/25075009:34
openstackgerritJulien Danjou proposed openstack/gnocchi: storage: fix expunge_metric  https://review.openstack.org/25473209:34
openstackgerritJulien Danjou proposed openstack/gnocchi: carbonara: serialize time period in seconds  https://review.openstack.org/25140209:34
openstackgerritJulien Danjou proposed openstack/gnocchi: carbonara: deprecate TimeSerieArchive  https://review.openstack.org/24090509:34
openstackgerritJulien Danjou proposed openstack/gnocchi: tests: block when acquiring processing lock  https://review.openstack.org/24913009:34
openstackgerritJulien Danjou proposed openstack/gnocchi: carbonara: allow to create TimeSerie from existing ts  https://review.openstack.org/25515509:34
openstackgerritJulien Danjou proposed openstack/gnocchi: carbonara: allow to split AggregatedTimeSerie  https://review.openstack.org/25515609:34
*** fawadkhaliq has joined #openstack-telemetry09:34
*** ildikov has quit IRC09:42
*** ViswaV_ has quit IRC09:49
openstackgerritsanjana proposed openstack/python-ceilometerclient: Restructuring Comment in Python-Ceilometerclient(alarms.py) Related-Bug: https://bugs.launchpad.net/python-ceilometerclient/+bug/1523866  https://review.openstack.org/25517109:58
openstackLaunchpad bug 1523866 in python-ceilometerclient "Unclear comment in CeilometerClient module" [Low,Triaged] - Assigned to sanjana (sanjana)09:58
*** zqfan_AFK has quit IRC10:01
*** nijaba has quit IRC10:02
*** openstackgerrit has quit IRC10:02
*** mattyw has joined #openstack-telemetry10:03
*** openstackgerrit has joined #openstack-telemetry10:03
*** ildikov has joined #openstack-telemetry10:09
*** ljxiash has quit IRC10:13
*** ljxiash has joined #openstack-telemetry10:14
*** sileht has quit IRC10:16
*** pece has joined #openstack-telemetry10:16
*** _nadya_ has joined #openstack-telemetry10:16
*** thorst has joined #openstack-telemetry10:18
*** ljxiash has quit IRC10:18
*** sileht has joined #openstack-telemetry10:19
*** sileht has quit IRC10:19
*** sileht has joined #openstack-telemetry10:20
*** thorst has quit IRC10:24
*** chaozhechen_ has quit IRC10:24
*** Chaozhe has quit IRC10:24
openstackgerritRyota MIBU proposed openstack/aodh: tempest: copy alarming client from tempest tree  https://review.openstack.org/25518710:28
openstackgerritRyota MIBU proposed openstack/aodh: tempest: copy api tests from tempest tree  https://review.openstack.org/25518810:28
openstackgerritRyota MIBU proposed openstack/aodh: tempest: copy conf.py from tempest tree  https://review.openstack.org/25518910:28
openstackgerritRyota MIBU proposed openstack/aodh: tempest: add alarming client manager  https://review.openstack.org/25519010:28
openstackgerritRyota MIBU proposed openstack/aodh: tempest: add aodh tempest plugin  https://review.openstack.org/25519110:28
openstackgerritRyota MIBU proposed openstack/aodh: WIP: tempest: use aodh client manager instead of tempest one  https://review.openstack.org/25519210:28
*** PSS has quit IRC10:29
*** caishan_ has quit IRC10:31
*** yassine__ has quit IRC10:56
*** fawadkhaliq has quit IRC10:57
*** fawadkhaliq has joined #openstack-telemetry10:57
*** fawadkhaliq has quit IRC11:03
*** thorst has joined #openstack-telemetry11:23
*** links has quit IRC11:26
*** thorst has quit IRC11:28
*** eglynn has joined #openstack-telemetry11:32
*** ljxiash has joined #openstack-telemetry11:32
*** yassine__ has joined #openstack-telemetry12:00
*** ljxiash has quit IRC12:01
*** links has joined #openstack-telemetry12:16
*** gordc has joined #openstack-telemetry12:24
*** thorst has joined #openstack-telemetry12:27
*** thorst has quit IRC12:33
*** thorst has joined #openstack-telemetry12:36
*** fawadkhaliq has joined #openstack-telemetry12:38
*** alejandrito has joined #openstack-telemetry12:40
*** zqfan_AFK has joined #openstack-telemetry12:42
*** boris-42_ has quit IRC12:43
*** _nadya_ has quit IRC12:43
*** thorst_ has joined #openstack-telemetry12:45
*** sergio_nubeliu has joined #openstack-telemetry12:47
*** shardy has quit IRC12:49
*** thorst has quit IRC12:49
*** claudiub has joined #openstack-telemetry12:50
*** shardy has joined #openstack-telemetry12:51
EmilienMgordc: bien?12:53
gordcEmilienM: ca va. you?12:56
EmilienMgordc: cold.12:57
EmilienMI wonder why I moved here.12:57
gordcit's very warm here. :)12:58
*** spredzy has joined #openstack-telemetry12:59
EmilienMI'll move to toronto one day13:00
*** julim has joined #openstack-telemetry13:01
gordcthere are many places better13:01
gordcwe don't want you here.lol13:01
*** Chaozhe has joined #openstack-telemetry13:02
*** chaozhechen_ has joined #openstack-telemetry13:02
*** Liuqing has joined #openstack-telemetry13:05
*** ildikov has quit IRC13:07
*** _nadya_ has joined #openstack-telemetry13:13
*** claudiub_ has joined #openstack-telemetry13:14
*** Chaozhe has quit IRC13:14
*** chaozhechen_ has quit IRC13:14
*** claudiub has quit IRC13:14
*** Chaozhe has joined #openstack-telemetry13:17
*** _nadya_ has quit IRC13:17
*** ildikov has joined #openstack-telemetry13:22
*** chaozhechen_ has joined #openstack-telemetry13:24
*** fawadkhaliq has quit IRC13:27
gordcsileht: should i use some sort of LRU cache for per resource lock?13:31
* cdent is feeling increasingly guilty13:38
*** diogogmt has joined #openstack-telemetry13:42
gordccdent: you should13:43
*** ljxiash has joined #openstack-telemetry13:44
gordccdent: maybe i should create set of locks which they all fight for?... i wonder if i can tell if a lock is being used.13:45
cdentis there some way you can use the existence of the cache key (which only lives for a certain amount of time) to expire the locks?13:47
cdentor just make sileht figure it out ;)13:47
gordccdent: so we'd have a background task clearing locks?13:47
cdentdunno, hadn't though of it that far13:48
cdentnot clearing locks, clearing lock keys13:48
gordchmm. i'm not sure per resource locks work... we could theorectically have hundred of thousands of resources active at any point so we'll never be able to expire it13:52
gordci think we need to create a set number of locks and they they fight... but then resources also have to fight if they already have a lock...13:53
gordcwhich could block out other resources...13:53
gordcdammit13:53
*** eglynn has quit IRC13:58
*** logan- has joined #openstack-telemetry14:01
openstackgerritJulien Danjou proposed openstack/gnocchi: storage: round back from_timestamp in get_measures()  https://review.openstack.org/25252514:01
openstackgerritJulien Danjou proposed openstack/gnocchi: carbonara: serialize time period in seconds  https://review.openstack.org/25140214:01
openstackgerritJulien Danjou proposed openstack/gnocchi: carbonara: deprecate TimeSerieArchive  https://review.openstack.org/24090514:01
openstackgerritJulien Danjou proposed openstack/gnocchi: carbonara: allow to split AggregatedTimeSerie  https://review.openstack.org/25515614:01
openstackgerritJulien Danjou proposed openstack/gnocchi: carbonara: allow to create TimeSerie from existing ts  https://review.openstack.org/25515514:01
silehtgordc, you can protect the dict with a lock :p14:04
silehtgordc, so the global locking time is just the time to do the dict manipulation14:05
silehtinstead of the time of the gnocchi resource creation14:05
openstackgerritMerged openstack/gnocchi: storage: fix expunge_metric  https://review.openstack.org/25473214:05
gordcsileht: what does the dict contain?14:08
silehtgordc, the dict{resource_id: lock}14:08
gordcsileht: won't the dict still have a key per resource?14:09
silehtif you want to cleanup a item dict you must be sure that the lock is not acquired14:09
gordcso have a cleanup tasks that runs periodically?14:09
*** ljxiash has quit IRC14:10
*** chaozhechen_ has quit IRC14:10
silehtgordc, or each time you  release the lock14:10
*** chaozhechen_ has joined #openstack-telemetry14:11
*** pece has quit IRC14:11
*** Chaozhe has quit IRC14:12
*** chaozhechen_ has quit IRC14:12
*** cdent has quit IRC14:12
gordcsileht: ah... i see.14:12
gordcwe can add that as a naive solution. i think at scale it'll be hundred of thousands of keys still but we'll worry about that when it happens.14:13
*** ljxiash has joined #openstack-telemetry14:13
*** cdent has joined #openstack-telemetry14:18
*** diogogmt has quit IRC14:24
*** diogogmt has joined #openstack-telemetry14:26
alejandritosileht, what i dont get from the implementation is ... does HEAT through the gnocchi resource, uses AODH alarming? or uses the OLD ceilometer alarm api ?14:27
alejandritosileht, i really want to understand that14:27
*** ildikov has quit IRC14:28
silehtalejandrito, from heat point that the same, it use python-ceilometerclient that take care to redirect to API to aodh if the aodh is present otherwise it send the request to ceilometer-api14:28
silehtalejandrito, rephrased: from heat point that the same, it use python-ceilometerclient that take care to redirect to API request to aodh API if the aodh endpoint is present otherwise it send the API request to ceilometer-api endpoint14:29
*** ildikov has joined #openstack-telemetry14:30
alejandritosileht, ok, so i now need to understand more things ... im using aodh and gnocchi from stable ... but ceilometer and ceilometer client is kilo release, so ... HOW is the ceilometer client realizing that the AODH endpoint exists ?14:31
silehtalejandrito, Not sure this case works14:32
alejandritosileht, if you want to drop me a doc i'll read it , specefically about the client redirecting to AODH when it exists and how to do it (keystone endpoint)14:32
gordchm... i don't know if i can lock the dict. that just makes all the threads fight for same lock again14:32
silehtalejandrito, backwardcompat have been introduced in liberty not kilo14:33
silehtgordc, yes but for a shorter time14:34
alejandritosileht, but since we've backported for example the gnocchi dispatcher on kilo, and works ok, maybe worth to know how its done in liberty to se if i can backport it, basically want to know how its done in liberty (what endpoint type to create for AODH, what config must be done for the client to realize that it needs to redirect to aodh, etc)14:35
silehtalejandrito, yes you can try the latest python-ceilometerclient lib14:35
*** ildikov has quit IRC14:35
silehtalejandrito, if your keystone have the aodh endpoint, the latest python-ceilometerclient will detect that automatically14:36
*** Chaozhe has joined #openstack-telemetry14:36
alejandritosileht, perfect, and what doc should i read to know how to perfectly add the AODH endpoint to keystone for the client to work ?14:37
*** chaozhechen_ has joined #openstack-telemetry14:37
*** diogogmt has quit IRC14:38
gordcsileht: but i'd have to lock it twice. lock dict to get resource lock, and lock again to possibly delete lock14:39
silehtalejandrito, I don't think that documented14:40
gordcalejandrito: you asking how to install aodh?14:41
*** pradk has joined #openstack-telemetry14:42
alejandritosileht, gordc nope, im just asking how (EG what service type) to add the AODH endpoint on keystone in the right way, so that the last python-ceilometerclient detects the aodh endpoint and redirects the alarms that heat creates to AODH14:42
silehtalejandrito, https://github.com/openstack/aodh/blob/master/devstack/plugin.sh#L12814:43
*** pradk has quit IRC14:43
silehtalejandrito, the service name is aodh and the type is alarming14:43
*** pradk has joined #openstack-telemetry14:44
alejandritosileht, perfect, i'll try that14:47
krotscheckAnyone here familiar with gabbi? I'm trying to write a test that asserts that an HTTP header is _NOT_ present, and doing a 'header_name: None' doesn't seem to work14:52
silehtkrotscheck, https://github.com/cdent/gabbi/issues/10814:52
krotschecksileht: Oh, well then!14:53
krotscheckThat's helpful14:53
cdentyeah, sorry about that krotscheck14:53
cdentin fact that bug was written when I was trying to write tests for the CORS stuff14:54
krotscheckcdent: No worries. Do you have any objections to me commenting those lines out for now until a syntax is developed?14:54
krotscheckAlso, is it valid yaml to start a property name with a !?14:55
krotscheckAs in "response_headers: !header_i_dont_want14:55
cdentI've not tested that, but that's one of the ideas that was suggested14:55
cdentwhich lines do you mean with regard to commenting?14:56
krotscheckHrm, it's a tag thing,14:56
*** Chaozhe has quit IRC14:57
krotscheckin https://review.openstack.org/#/c/224464/12/ceilometer/tests/functional/gabbi/gabbits/middleware.yaml, lines 25/26, 42/4314:57
*** rbak has joined #openstack-telemetry14:58
cdentyeah, that would be cool. leave a brief comment saying why14:58
alejandritosileht, is there a plan to have a python-aodhclient ? or the alarming part will be still being used by the ceilometerclient and redirecting ?14:58
silehtalejandrito, we have planned to create python-aodhclient but nobody have taken the tasks yet14:59
krotscheckcdent: Does that bug read ... "today it's response_header_not_preset"... like that would actually work?15:00
* krotscheck checks15:00
krotscheckNope, invalid key15:00
*** ddieterly has joined #openstack-telemetry15:00
*** ljxiash_ has joined #openstack-telemetry15:02
gordcsileht: i'll probably start next week if no one takes it. i'm just going to copy everything you did in gnocchiclient15:02
silehtgordc, that's a good plan15:02
cdentkrotscheck: no that's jason saying "if we do this now, what will be the mess that comes later for additional cases"15:04
*** claudiub_ has quit IRC15:04
*** ljxiash has quit IRC15:05
cdentgiven that headers are "special" in gabbi it might be easiest to just go with that option: here's a list of headers that shouldn't be present15:05
cdentit's contained15:05
cdentsileht, krotscheck: if you guys can think of a good name, I could implement that functionality pretty easily and quickly15:06
*** diazjf has joined #openstack-telemetry15:08
gordcnot_*15:09
gordccdent: i'm not creative.15:09
cdentnot_response_header: ?15:10
gordcsure15:10
*** donghao has joined #openstack-telemetry15:10
cdentdoes that have sufficient meaning (to you)?15:10
*** donghao has quit IRC15:10
cdentI guess it probably does, especially when the value is a list15:10
gordci'm just basing it on the fact that i know what response_header is and i know what not usually does15:11
silehtforbidden_response_headers15:11
silehtprevent_response_headers15:11
cdentthou shalt not have these headers15:11
gordcsileht is more fancy.15:11
cdentas you would expect, really15:12
silehtunexpected_response_headers15:12
sileht:p15:12
cdent:)15:12
gordcdo_not_want_these_*15:12
*** chaozhechen_ has quit IRC15:12
gordchttp://www.thesaurus.com/browse/not15:13
gordcnay_*15:13
cdentshun15:14
*** chaozhechen_ has joined #openstack-telemetry15:15
krotscheckI'd opt for some kind of generic negation marker.15:16
cdentnegation is problematic because it has two different meanings: this header does not have this value is not the same as this header is not present at all15:16
krotscheckMy initial instinct was "header_i_dont_want: None"15:17
cdentwhat if the header is present with no value?15:17
cdent(which is physically possible)15:17
krotscheckTrue, but even so I'm in favor of intuitive things.15:18
gordccdent: i think no value and not present are different things15:19
cdentgordc exactly15:19
*** ildikov has joined #openstack-telemetry15:20
krotscheckHow about -header_i_dont_want15:24
*** diogogmt has joined #openstack-telemetry15:25
gordckrotscheck: i like how you gave gabbi an identity ;)15:25
krotscheckgordc: "Gabbi" is a german colloquial for "Gabriele" or "Gabriela". :)15:26
* krotscheck has his origins showing15:26
gordc:)15:27
krotscheckA minus prefix is not valid yaml :/15:28
cdenta german friend of mine insist that gabbi is a common name for a german prostitute15:28
krotscheckThat could be, I'm not up to date on today's wording.15:29
krotschecks/wording/usage/15:29
gordc... is that why you choose the name for lib?15:29
gordci'm starting to second guess whether we should've adopted it.15:30
*** ljxiash_ has quit IRC15:30
*** Ephur has joined #openstack-telemetry15:30
cdentgordc: no, I didn't know when I chose the name15:31
gordccdent: sure sure.15:31
cdentbasically I was going to call it gabby (for talkative), but I thought the 'i' would make it easier to make an acronym15:31
gordcyou folks are very creative. i created ceilometermiddleware. it's middleware, ceilometer uses it. ceiloemtermiddleware.15:33
*** thorst_ has quit IRC15:35
openstackgerritPradeep Kilambi proposed openstack/ceilometer: Change to allow non-metric meters  https://review.openstack.org/24824115:37
* krotscheck is usually in gordc's camp.15:38
*** belmoreira has quit IRC15:39
*** Liuqing has quit IRC15:47
*** nijaba has joined #openstack-telemetry15:47
*** nijaba has quit IRC15:47
*** nijaba has joined #openstack-telemetry15:47
*** itxaka has joined #openstack-telemetry15:49
*** diazjf has quit IRC15:50
*** ljxiash has joined #openstack-telemetry15:52
*** ljxiash has quit IRC15:56
openstackgerritMichael Krotscheck proposed openstack/ceilometer: Added CORS support to Ceilometer  https://review.openstack.org/22446415:56
krotscheckOk, that _should_ work.15:57
* krotscheck grumbles about oslo sideloading configs.15:58
*** smurke has joined #openstack-telemetry15:59
krotscheckDoes ceilometer use custom headers other than X-Auth-Token and X-Openstack-Request-Id?16:01
*** pradk has quit IRC16:05
gordckrotscheck: i don't think we use anything aside from typical headers from keystone16:06
krotscheckgordc: Sweet, then I won't have to update that patch then :)16:06
krotscheck(Assuming it passes this time)16:06
krotscheckIncidentally, I'm kindof liking gabbi.16:06
gordckrotscheck: don't pad cdent's ego.16:07
cdentkrotscheck: excellent, glad to hear it.16:07
* cdent slaps gordc down (again)16:07
gordcdammit!16:07
*** vishwanathj has quit IRC16:08
*** vishwanathj has joined #openstack-telemetry16:08
cdenti've been wanting to get it in more projects but haven't had time16:08
krotscheckWell, it's especially pertinent because right now I'm writing a ton of API mocks in javascript test harnesses, and the ability to just describe the "If request then return" as yaml seems too easy to give up.16:09
cdentthere's work in progress to get it useful with html and forms16:09
cdenthave you seen the gabbi-run command line tool?16:09
gordccdent: i thought it was because openstack community made you jaded... just me? cool.16:09
cdentgordc I want it used in more openstack projects but not be considered an openstack project (or be under infra) as that discourages some people from wanting to participate16:10
krotscheckcdent: So, random concept.16:10
*** pradk has joined #openstack-telemetry16:10
krotscheckcdent: Is it possible ot use gabbi markup as a... shared abstraction layer? As in, I have a shared YAML file, and when run against an API makes sure that the tests pass, but then I can also run it as a mock data server and run my javascript integration tests against it without having to spin up devstack.16:12
krotschecki.e. the Gabbi yaml markup is "Here's the API contract"16:12
cdentsomething like swagger or raml is probably more appropriate for that, but I've found them both a bit noisy16:13
cdentI've thought about swagger2gabbi and gabbi2swagger but: time is lacking16:13
krotscheckEeeeehh.... I don't know about swagger. That's more of a UI, no?16:13
krotscheckRAML, however....16:13
* krotscheck ponders.16:13
cdentswagger's a yaml format that can produce an explorer UI16:13
*** sergio_nubeliu has quit IRC16:17
*** ljxiash has joined #openstack-telemetry16:21
*** diogogmt has quit IRC16:22
*** sergio_nubeliu has joined #openstack-telemetry16:23
silehtgordc, your still on the resource lock thing or can I propose something ?16:33
silehtyour/your are16:33
silehtyour/you are16:33
gordcsileht: i was thinking something like this: http://paste.openstack.org/show/481337/16:35
gordcactually never mind, i don't hink that works.16:36
gordcsileht: go ahead16:36
gordchmm.. or will it work... i haven't really tried it out16:37
* cdent blinks16:37
*** yassine__ has quit IRC16:38
gordcthreading is too damn hard. /me goes back to drawing lines on paper16:38
cdentare we quite certain the caching is worth this effort?16:39
cdentWhen I posted the WIP it was basically a way of saying "what if we did this?" not "if we dont' do this the world will explode"16:39
cdentthat is: do measurements support the effort16:40
gordccdent: i think it's the update call we're trying to avoid? let's me check if i timed it.16:41
cdentwhen I did my initial explorations I was saving a _lot_ of calls to both create and update (but mostly update)16:42
cdentbecause it was wanting to try for every dispatch16:42
cdentso conceptually it ought to be a huge win16:42
*** ctina_ has joined #openstack-telemetry16:43
gordcit looks like it should really only save create calls whenver we first see a resource.16:43
gordcit shouldn't be calling it after that initial flood comes in right?16:43
gordcwe should make gnocchi act nosql and handle it internally. problem solved.16:44
gordclet's all sleep16:44
cdentgnocchi _does_ handle it. What we're trying to avoid is asking gnocchi to handle it (thus avoiding the http request)16:44
gordchuh? i meant like here's a blob of data, figure it out.16:45
gordcright now we are explicitly saying this resource, this metric, blob of measuremetns16:46
cdentwithout the cache, there is no way, in the dispatcher, to know if the resource associated with the current list of samples is on gnocchi already16:46
cdentper list of samples we only need to check once16:46
cdentbut we get samples often16:46
gordcyeah, so nosql approach would be not to care. it would create that resource model for you16:46
gordci'm using nosql term very loosely here16:46
cdentseem so16:47
gordcit's just more that right now we need to define schema... where tyipically nosql is just dump16:47
gordcsileht: http://paste.openstack.org/show/481339/16:50
gordcwhat about that?16:50
gordcbasically it only deletes if it can... i have no idea if it'll ever be successful16:51
silehtgordc, that looks better16:51
*** _nadya_ has joined #openstack-telemetry16:51
gordcsileht: what was your idea?16:52
silehtgordc, my idea uses one lock and one condition to handle all resources locks: http://paste.openstack.org/show/481341/16:54
*** mattyw has quit IRC16:55
gordcsileht: yeah, i thought about using something like that, but i don't knwo conditions well enough16:55
gordcsileht: feel free to post it. i'm going to read up on conditions16:55
silehtgordc, the bad thing we condition is that is wakeup all threads when only one must be unblocked16:55
silehtwe/with16:56
*** thorst has joined #openstack-telemetry16:56
silehtgordc, yours use more memory but doesn't have this all threads wakeup16:56
*** prashantD has joined #openstack-telemetry16:56
silehtgordc, I prefer yours16:56
gordcsileht: ah i see, yeah, the whole communication between all the threads started to make my brain hurt16:57
*** ljxiash has quit IRC16:57
silehtand its smaller and easier to understand16:57
gordcwhich is why i stopped reading conditions16:57
silehtgordc, you should remove blocking=False line 1116:58
silehtgordc, so the collections will be cleaned correclty16:58
gordcsileht: hmm.. i added it in if another thread was getting lock, delete would just skip17:00
gordcgetting lock from dict*17:01
silehtgordc, the line 12 already protect that17:01
*** links has quit IRC17:01
gordcsileht: ah! yeah, i see what you're saying.17:02
gordcshould i change line12 to call self.__getitem__ then?17:02
gordcor maybe i don't get what you're saying.lol dammit threads!17:03
gordci think basic idea i'm trying is self.lock(blocking=false) locks the dict if it can...17:04
gordcand collections.defaultdict.__getitem__(self, key)(blocking=False) locks the resource lock if it can... and (hopefully) i can delete it safely then becasue no other thread can use resource lock or dict.17:06
*** diogogmt has joined #openstack-telemetry17:08
*** rcernin has quit IRC17:11
*** diogogmt_ has joined #openstack-telemetry17:13
*** diogogmt has quit IRC17:13
*** diogogmt_ is now known as diogogmt17:13
*** Chaozhe has joined #openstack-telemetry17:15
openstackgerritgordon chung proposed openstack/ceilometer: add per resource lock  https://review.openstack.org/25318117:16
*** jaypipes has quit IRC17:25
*** yprokule has quit IRC17:30
cdentkrotscheck: if you're still around: would 'response_forbidden_headers' be okay? If it has 'response' on the start the code is _much_ easier to integrate17:31
cdentsileht, gordc ^17:31
silehtso go for it :)17:31
* cdent is very particular about the names of the test keys17:31
cdentI'm probably too particular17:31
gordccdent: is this a fake question to make it seem like i have a say?17:32
cdentaw17:32
gordccdent: i'm cool with it. response_headers_forbidden?17:33
gordci'm joking.17:33
gordci really just copy paste whatever exists.17:33
krotscheckcdent: Works for me!17:33
cdent17:34
cdent"AssertionError: Forbidden header x-gabbi-url found in response"17:42
krotscheckcdent: nice!17:43
*** itxaka has quit IRC17:52
*** smurke has quit IRC17:57
*** _nadya_ has quit IRC18:01
*** Chaozhe has quit IRC18:02
*** chaozhechen_ has quit IRC18:02
*** Chaozhe has joined #openstack-telemetry18:05
*** chaozhechen_ has joined #openstack-telemetry18:05
*** safchain has quit IRC18:09
openstackgerritMerged openstack/gnocchi: tests: block when acquiring processing lock  https://review.openstack.org/24913018:10
cdentkrotscheck: in case you're curious or want to review https://github.com/cdent/gabbi/pull/10918:15
*** _nadya_ has joined #openstack-telemetry18:16
krotscheckcdent: Looking18:17
krotscheckcdent: Seems sane18:18
cdentI'll chase up jason or fnd for some additional commentary while I eat dinner and barring somebody saying eek, I'll release it tonight18:18
krotscheckcdent: Neat!18:19
*** smurke has joined #openstack-telemetry18:21
openstackgerritPradeep Kilambi proposed openstack/python-gnocchiclient: Fix delete metric on resource create/update  https://review.openstack.org/25542618:30
*** ViswaV has joined #openstack-telemetry18:33
*** ViswaV has quit IRC18:37
*** ViswaV has joined #openstack-telemetry18:38
*** _nadya_ has quit IRC18:53
*** david-ly_ has joined #openstack-telemetry19:00
*** david-ly_ is now known as david-lyle_19:03
*** david-lyle has quit IRC19:03
*** david-lyle_ is now known as david-lyle19:04
*** chaozhechen_ has quit IRC19:05
*** Chaozhe has quit IRC19:05
*** diazjf has joined #openstack-telemetry19:33
openstackgerritLianhao Lu proposed openstack/ceilometer: verify gnocchi connection before processing  https://review.openstack.org/25363519:37
*** mattyw has joined #openstack-telemetry19:38
*** _cjones_ has joined #openstack-telemetry19:45
cdentkrotscheck: new version released: https://pypi.python.org/pypi/gabbi19:50
*** david-lyle has quit IRC19:58
*** david-lyle has joined #openstack-telemetry19:58
*** cdent has quit IRC20:08
*** belmoreira has joined #openstack-telemetry20:41
*** diazjf has quit IRC20:50
*** diazjf has joined #openstack-telemetry20:52
*** diazjf has quit IRC20:57
*** diazjf has joined #openstack-telemetry20:58
*** ctina_ has quit IRC21:09
*** thorst has quit IRC21:12
*** thorst has joined #openstack-telemetry21:13
*** cdent has joined #openstack-telemetry21:15
alejandritogordc, sileht, jd__ is there an official service type in keystone for the gnocchi endpoint ?21:18
silehtalejandrito, alarming21:19
openstackgerritgordon chung proposed openstack/ceilometer: add per resource lock  https://review.openstack.org/25318121:19
alejandritosileht, for GNOCCHI too ?21:19
gordcmetric21:19
gordcsorry biab. stepping out21:19
alejandritosileht, gordc, perfect service type METRIC21:20
*** sergio_nubeliu has quit IRC21:21
*** thorst has quit IRC21:21
gordc:)21:23
* sileht should read the whole sentence before answer...21:23
gordclol21:26
*** belmoreira has quit IRC21:26
openstackgerritMerged openstack/gnocchi: Adds aggregation across metrics tests  https://review.openstack.org/25298321:37
openstackgerritMerged openstack/gnocchi: Checks percent_of_overlap when one boundary is set  https://review.openstack.org/25303521:37
openstackgerritMerged openstack/gnocchi: Adds some docs about aggregation across metrics  https://review.openstack.org/25303621:37
*** gordc has quit IRC21:39
*** gordc has joined #openstack-telemetry21:47
*** diazjf has quit IRC21:54
openstackgerritOpenStack Proposal Bot proposed openstack/ceilometer: Updated from global requirements  https://review.openstack.org/25389021:55
openstackgerritOpenStack Proposal Bot proposed openstack/ceilometermiddleware: Updated from global requirements  https://review.openstack.org/25554921:55
openstackgerritgordon chung proposed openstack/ceilometer: Revert "Revert "devstack config for dogpile cache""  https://review.openstack.org/25556922:07
*** smurke has quit IRC22:10
openstackgerritgordon chung proposed openstack/ceilometer: Revert "Revert "devstack config for dogpile cache""  https://review.openstack.org/25556922:10
*** zqfan_AFK has quit IRC22:11
*** rbak has quit IRC22:15
krotscheckcdent: Sweeeeet, thanks :)22:19
*** thorst has joined #openstack-telemetry22:19
cdentthank you for giving the push that made it happen. Nothing gets done without that.22:19
krotscheckcdent: I'm a professional squeaky wheel :)22:22
*** thorst has quit IRC22:22
*** thorst has joined #openstack-telemetry22:22
cdent:)22:22
*** thorst has quit IRC22:24
*** thorst has joined #openstack-telemetry22:24
*** alejandrito has quit IRC22:26
*** thorst has quit IRC22:29
*** david-lyle has quit IRC22:34
openstackgerritMichael Krotscheck proposed openstack/ceilometer: Added CORS support to Ceilometer  https://review.openstack.org/22446422:34
*** larainema has quit IRC22:37
*** david-ly_ has joined #openstack-telemetry22:39
*** patrickeast has quit IRC22:40
*** shardy has quit IRC22:45
*** david-ly_ is now known as david-lyle22:45
*** mattyw has quit IRC22:46
*** harlowja has quit IRC22:51
*** harlowja has joined #openstack-telemetry22:51
*** boris-42_ has joined #openstack-telemetry22:59
*** rbak has joined #openstack-telemetry23:19
*** Ephur has quit IRC23:25
*** thorst has joined #openstack-telemetry23:27
*** thorst has quit IRC23:34
*** larainema has joined #openstack-telemetry23:34
*** rcernin has joined #openstack-telemetry23:38
*** pradk has quit IRC23:40
*** claudiub has joined #openstack-telemetry23:42
openstackgerritgordon chung proposed openstack/ceilometer: fix events rbac  https://review.openstack.org/23482323:42
harlowjagordc yt23:42
harlowjacdent23:42
harlowjai gotta question for u all23:43
cdenthowdy23:43
harlowjayo yo23:43
gordcharlowja: i'm stepping out.23:43
harlowjakk23:43
gordcwill wait a few min to see if it's easy23:43
harlowjaits about scheduling and utilization aware scheduling23:43
harlowjanot so easy probably23:43
gordc...nope.lol23:43
harlowja;)23:43
gordcall on cdent.23:44
harlowjaa folk internally is starting to get involved in this (cause well it makes sense)23:44
gordci'll read eavesdrop or check mail if needed.23:44
harlowjakk23:44
gordclatesr23:44
*** gordc has quit IRC23:44
harlowjaannnnnd before it gets to deep into well we will extend nova to do more and more and more and more resource awareness and tracking and ... welllll maybe i'm thinking u guys have some known plan on this anyway23:44
harlowjaand i was like welllll why not talk with u guys (and i'm here to do a little of that before i guess, ha)23:45
cdentsounds interesting but first a caveat: it's nearly midnight and I've had a long day so I'm pretty stupid at the moment23:45
harlowjai'm stupid all the time23:45
harlowjalol23:45
cdentstupids unite!23:45
harlowja;)23:45
openstackgerritMichael Krotscheck proposed openstack/ceilometer: Added CORS support to Ceilometer  https://review.openstack.org/22446423:45
harlowjaderp23:45
harlowjaso maybe can discuss other time, thats fine, i just wanted to see if people have been thinking about it23:45
cdentso, weirdly, I've sort of moved over to nova-land a bit and tracking resources, resource usage, and scheduler stuff is where I'm going to be poking23:45
harlowjaaka, the feedback loop of nova -> nova-scheuduler -> nova-compute -> vms -> metrics -> cielometer(?) -> nova ....23:46
harlowjacdent hmmmm23:46
cdentwithin ceilometer there is a frequent debate about "what's all this data for" that has never been resolved well23:46
harlowja:)23:46
harlowjastupids will figure it out23:46
harlowjago stupid!23:47
harlowjalol23:47
harlowjaok, perhaps we can talk when less stupid is about23:47
cdentI overhead a conversation a couple days ago of someone saying "if we do come up with some kind of notification driven resource tracking it will at least have to support using ceilometer if not specifically use it"23:48
harlowjaya23:48
cdentso I reckon this is something which is kind of on people's minds23:48
harlowjahttps://review.openstack.org/#/c/254423/ is popping up (from a fellow coworker at y!)23:48
* cdent marks that for later review23:49
harlowjaits similar, and got me thinking about this and the path forward here (not just the short-term path, of shove stuff into nova...)23:49
harlowjamight as well use that data for something imho :)23:49
cdentmy concern with a focus on ceilometer's style of handling such data is that ceilometer is usually concerned with the aggregation of the info over time23:49
harlowjause stupid scheduling until enough information has been gathered?23:49
harlowjathen use less stupid one basedo n data23:50
harlowja?23:50
cdentwhereas resource tracking is more about "how much of this do we have _now_" driven by hearing information about consumption23:50
cdent"instance X just at 5GB RAM"23:50
cdents/at/ate23:50
harlowjatasty23:50
*** ljxiash has joined #openstack-telemetry23:50
cdentI need to learn more about the existing metric driven filters to really know what I'm talking about23:51
cdentbecause thus far my intuitive reaction to the scheduler in general has been "weird"23:51
harlowjaya, let me see if i can get the coworker guy to get in here, when u are less tired23:51
*** patrickeast has joined #openstack-telemetry23:51
harlowjahe should be able to be a good explainer of it (i would hope)23:51
cdentsounds like an excellent plan23:51
harlowjacool23:51
cdentafternoons/early evenings UTC are usually best23:51
harlowjakk23:52
cdentfor me having a somewhat less stupid (but still stupid) brain23:52
harlowjau can never get all the way rid of the stupid23:52
harlowjai've tried23:52
cdentyou might catch more fish with a mailing list post targeting both nova and ceilo23:52
harlowjaright23:52
harlowja*eventually that i think23:52
cdentyeah, finding the ground might be good first23:52
cdentI reckon this is a fine opportunity for me to go to be23:53
cdentd23:53
cdentbut yeah, look for me later23:53
* cdent bows out23:54
cdentg'night23:54
harlowja:)23:54
harlowjalata23:54
*** cdent has quit IRC23:54
*** ljxiash has quit IRC23:55
* krotscheck wonders if cdent got around to doing a global requirements patch for gabbi23:56
* krotscheck goes to check23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!