15:01:17 <eglynn> #startmeeting ceilometer
15:01:18 <openstack> Meeting started Thu Jun 12 15:01:17 2014 UTC and is due to finish in 60 minutes.  The chair is eglynn. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:01:19 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
15:01:21 <openstack> The meeting name has been set to 'ceilometer'
15:01:27 <llu-laptop> o/
15:01:28 <sileht> o/
15:01:29 <nsaje> o/
15:01:30 <DinaBelova> o/ (50%)
15:01:35 <prad> o/
15:01:41 <eglynn> sorry for the slightly late start ...
15:01:44 <fabiog> o/
15:01:44 <ildikov> o/
15:01:48 <jd__> o/
15:02:07 <eglynn> #topic juno-2 planning
15:02:13 <gordc> o/
15:02:22 <eglynn> first things first, juno-1 is out! :)
15:02:32 <eglynn> #link https://launchpad.net/ceilometer/+milestone/juno-1
15:02:42 <eglynn> thanks for your efforts folks! :)
15:03:09 <eglynn> most of what we'd target'd for juno-1 actually made it, which is good :)
15:03:32 <eglynn> hbase-resource-rowkey-enhancement bumped to j2, but should land once the gremlins in the gate are squashed
15:04:02 <eglynn> ... also had to bump good patches for LP #1326250 #1326723 #1293337 to j2, due to gate lag :(
15:04:03 <uvirtbot> Launchpad bug 1326250 in ceilometer "swift broken when ceilometer middleware is enabled" [High,In progress] https://launchpad.net/bugs/1326250
15:04:27 <DinaBelova> btw - we actually merged first pack of tempest tests this morning - as tempest is branchless and etc. - we have our first tests in j1, really :)
15:04:47 <eglynn> DinaBelova: excellent!
15:04:56 <DinaBelova> eglynn, ;)
15:04:58 <sileht> the dream come true :)
15:05:20 <DinaBelova> so we are on our way :)
15:05:36 <ildikov> DinaBelova: \o/ :)
15:06:09 <eglynn> so, other than the bumpees from juno-1 ...
15:06:20 <eglynn> the cupboard is currently looking slightly bare WRT juno-2 ...
15:06:23 <eglynn> #link https://launchpad.net/ceilometer/+milestone/juno-2
15:07:09 <eglynn> a very rough laundry list of stuff that may be in the game for j2 follows ...
15:07:20 <fabiog> eglynn: I have a proposal that could land there - https://review.openstack.org/#/c/95817/
15:08:12 <eglynn> fabiog: thanks, I'll look off-line
15:08:21 <ildikov> eglynn: IIRC, there were some separate BP comments in the Gnocchi spec too
15:08:48 <eglynn> ildikov: got a link?
15:08:53 <ildikov> eglynn: I'm not sure if any of those could fit into j-2 though
15:09:32 <ildikov> eglynn: I haven't checked if they were even created after, one of these is the pipeline design
15:09:50 <eglynn> ildikov: not sure what you mean by "BP comments in the Gnocchi spec"?
15:10:30 <ildikov> eglynn: that it will be specified in a separate BP, like how the pipeline design will look like
15:10:48 <eglynn> a-ha, ok
15:10:54 <ildikov> eglynn: but maybe we just simply not there yet, I will check later
15:11:08 <eglynn> so here's a very rough list of possibilities ...
15:11:19 <eglynn> sql-a viability phase2
15:11:25 <eglynn> documentation improvements
15:11:32 <eglynn> event persisence in mongo
15:11:42 <eglynn> code-free meters
15:11:48 <eglynn> SNMP improvements
15:11:55 <eglynn> central agent repartition
15:11:56 <ildikov> eglynn: what do you mean by docco improvements?
15:12:14 <Alexei_987> eglynn: can we discuss central agent repartition a bit more?
15:12:34 <eglynn> ildikov: basically the TC gap coverage task
15:12:50 <eglynn> Alexei_987: one sec, lemme just run thru' the rough list quickly
15:12:57 <eglynn> consume IPMI sensor data from ironic
15:12:58 <Alexei_987> k
15:13:03 <eglynn> network services metering
15:13:10 <eglynn> grenade phase2 (javelin)
15:13:16 <eglynn> per-project pipeline
15:13:23 <eglynn> complex queries for stats
15:13:27 <ildikov> eglynn: it's already a BP in OS Manuals and agreed to fit in j-2 somehow, so it's not on our list
15:13:35 <eglynn> gnocchi/ceilo-core integration
15:13:47 <eglynn> ildikov: k
15:14:19 <ildikov> eglynn: complex query waits for Gnocchi until someone tells me that it should be implemented for the current design
15:14:23 <DinaBelova> tempest testing - also j2, as I remember
15:14:38 <ildikov> eglynn: the pipeline design for Gnocchi could fit into the last topic you mentioned
15:14:51 <eglynn> DinaBelova: ... yep, tho' does it need a BP also?
15:14:53 <eglynn> ildikov: yep
15:15:03 <ildikov> eglynn: and on top of that can come the dynamic config and the per-project pipeline
15:15:04 <DinaBelova> eglynn - tempest spec
15:15:05 <DinaBelova> :)
15:15:13 <DinaBelova> so probably no in the ceilo
15:15:43 <eglynn> so basically, if any you intend to work on any of the above item and there isn't already a BP spec
15:15:49 <eglynn> ... please propose one to ceilometer-specs
15:16:05 <eglynn> did I leave out anything?
15:16:26 <zqfan> hi, I'd like to implement the bp https://blueprints.launchpad.net/ceilometer/+spec/advanced-policy-rule in j-2, not sure if there is any conflict to our plan
15:16:42 <zqfan> which is not approved yet :(
15:16:50 <eglynn> zqfan: have you proposed a spec to ceilometer-specs?
15:16:50 <ildikov> eglynn: I think it's a long enough rough list already ;)
15:17:06 <zqfan> not yet, that is registered long time ago
15:17:19 <eglynn> so in general, here's how ttx wants the BP process to work now ...
15:17:27 <eglynn> 1. propose spec to ceilo-specs
15:17:34 <eglynn> 2. core team review & approve
15:17:54 <ttx> 3. use my awesome spec2bp to turn the spec into a blueprint
15:17:59 <eglynn> 3. ceilo-drivers or PTL files a corresponding BP on launchpad and links to the spec
15:18:09 <eglynn> a-ha, ttx, even better!
15:18:13 <DinaBelova> ttx, heh - magic :)
15:18:16 <ttx> (not ready yet)
15:18:23 <zqfan> eglynn, ok, will upload the spec tomorrow
15:18:29 <ttx> that was a teaser, sorry for interrupting :)
15:18:40 <eglynn> zqfan: ... so the point is, the entry point is now ceilo-specs, not the launchpad BP
15:18:42 <llu-laptop> ttx: where can we learn that magic?
15:18:56 <DinaBelova> llu-laptop - teaser :(
15:19:03 <zqfan> eglynn, ok
15:19:08 <DinaBelova> as ttx said :)
15:19:13 <ttx> llu: will be in openstack-infra/release-tools when complete
15:19:25 <llu-laptop> :(
15:19:28 <eglynn> further ttx magic includes an auto-kick script that'll untarget any BPs that don't follow the above workflow
15:19:47 <eglynn> Alexei_987: so you wanted to discuss central agent repartition?
15:19:57 <Alexei_987> eglynn: small POC here https://github.com/temujin/ceilometer-parallel-agent/commit/cd154f22a0b15c7bf2f6dcbbe72404c71ca206bf
15:20:04 <KurtRao> eglynn: can you please explain a little bit more about "code-free metering"?
15:20:20 <Alexei_987> eglynn: slight change in processing flow that allows us to fork central agent without external HA tools
15:20:33 <eglynn> KurtRao: discussed at summit https://etherpad.openstack.org/p/ceilometer-snmp-inspector
15:20:39 <Alexei_987> eglynn: so no need in master election
15:20:47 <DinaBelova> Alexei_987 - so you just make it stateless?
15:20:52 <gordc> Alexei_987: any reason you want to avoid using taskflow?
15:20:58 <eglynn> KurtRao: (second half of that etherpad)
15:21:07 <Alexei_987> gordc: additional complexity in configuration
15:21:25 <Alexei_987> gordc: it's much easier to handle it on our side
15:21:30 <DinaBelova> gordc, I guess Alexei_987 is trying to avoid tooz :-\
15:21:51 <DinaBelova> no the taskflow
15:21:58 <Alexei_987> DinaBelova: any external lib brings configuration, maintanance, compatibility burden
15:22:13 <Alexei_987> if we can avoid using it why not?
15:22:28 <KurtRao> eglynn: got it. Very interesting feature
15:22:34 <eglynn> Alexei_987: so the plan was to use taskflow/tooz for central agent & partitioned alarm eval
15:23:05 <Alexei_987> eglynn: And my opinion is that we can change our algorithms so it won't be needed
15:23:28 <llu-laptop> Alexei_987: how?
15:23:34 <Alexei_987> just like POC provided
15:23:44 <eglynn> Alexei_987: can you propose your PoC to gerrit? ... and we can continue the discussion there?
15:23:47 <Alexei_987> llu-laptop: using stuff that we already have available
15:23:54 <Alexei_987> eglynn: sure we can
15:24:26 <Alexei_987> eglynn: need to update tests so
15:24:39 <Alexei_987> eglynn: my main question is do we want it or not?
15:24:57 <koteswar16> hi all, would you please approve this https://review.openstack.org/#/c/95526/
15:25:01 <jd__> that's based on a database to distribute the tasks?
15:25:07 <Alexei_987> jd__: yes
15:25:10 <gordc> Alexei_987: i'd hold off on building tests
15:25:48 <Alexei_987> gordc: why?
15:25:54 <jd__> ok, do not want
15:26:00 <Alexei_987> jd__: why?
15:26:00 <gordc> Alexei_987: i think we all need to take a look at it first... so you don't waste your time
15:26:14 <Alexei_987> gordc: you can look on github in such case
15:26:19 <Alexei_987> and leave comments there
15:26:25 <eglynn> koteswar16: that's a neutron patch?
15:26:30 <Alexei_987> gordc: on gerrit it will not pass jenkins
15:26:58 <eglynn> Alexei_987: k, if it's proposable to gerrit, let's do a pre-review on github
15:27:11 <eglynn> ... it's not proposable to gerrit
15:27:33 <eglynn> move on?
15:27:40 <Alexei_987> ok
15:27:42 <gordc> Alexei_987: yeah... but just saying. people will have questions about design alone... tests might be jumping the gun since plans might change.... if you're free i guess you can code tests.
15:28:01 <gordc> eglynn: works for me... we can comment on design offline.
15:28:06 <eglynn> #topic Gremlins in the gate
15:28:10 <eglynn> so a major spike in our py26 unit test failure rate
15:28:10 <ildikov> eglynn: +1
15:28:17 <eglynn> http://jogo.github.io/gate/
15:28:30 <eglynn> due to https://bugs.launchpad.net/ceilometer/+bug/1328679
15:28:31 <uvirtbot> Launchpad bug 1328679 in ceilometer "string io errors in unit test" [Medium,Triaged]
15:28:45 <eglynn> sileht: white smoke on https://review.openstack.org/99654 ?
15:28:56 <sileht> eglynn, yes
15:29:05 <eglynn> sileht: \o/ :)
15:29:20 <sileht> eglynn, because of eventlet we should never have timeout in tests
15:29:43 <eglynn> sileht: ... so can you un-WIP the patch?
15:30:08 <sileht> eglynn, I want to do a tone of recheck to be sure it sufficient
15:30:14 <gordc> eglynn: am i reading graph right? the failures have disappeared as of today?
15:30:20 <sileht> eglynn, I can't reproduce it locally
15:30:22 <eglynn> sileht: cool, wise
15:30:36 <eglynn> gordc: scroll down to the 3rd graph
15:30:42 <llu-laptop> sileht: why we can't have timeout, it's a eventlet semaphore
15:30:58 <eglynn> gordc: sorry that's py27 ... my bad
15:31:00 <ildikov> eglynn: that's py27
15:31:02 <koteswar16> @Sylvain Afchain: would u please approve this https://review.openstack.org/#/c/99654/ ??
15:31:07 <gordc> eglynn: or just because we're not running tests... so it tapered off.
15:32:08 <sileht> llu-laptop, in case of test_notification is the first test to run, then eventlet pause it (because oslo.messaging use time.sleep), then all others tests are run (that take more than 2*30 seconds)
15:33:05 <sileht> llu-laptop, this is my guessing
15:33:47 <eglynn> sileht: so it sounds plausible, I guess we just need a few more green rechecks to give further confidence?
15:34:06 <sileht> eglynn, yes
15:34:47 <sileht> eglynn, but I think this is unreallated with the py27 gate issue, because this one seems fail only in py26
15:35:03 <eglynn> sileht: yeah I've only seen it on py26
15:35:12 <eglynn> sileht: cool enough... so once you're confident, let's try to get that puppy landed
15:35:37 <eglynn> move on?
15:35:56 <eglynn> #topic TSDaaS/gnocchi update
15:36:12 <eglynn> jd__: the floor is yours, sir!
15:36:22 <jd__> thanks
15:36:35 <jd__> So as promised I've started to integrate with Ceilometer
15:36:44 <eglynn> cool
15:36:55 <jd__> the PoC has been developed as a dispatcher driver
15:37:08 <jd__> so it plugs at the collector level, and tries to map the samples received to what Gnocchi expects
15:37:10 <jd__> https://review.openstack.org/#/c/98798/
15:37:21 <eglynn> *cough*, *cough* ... is that somthing that could be written up in a BP spec possibly?
15:37:28 <jd__> it's early stage and for now it just create the instances resources in Gnocchi that's it
15:37:34 <jd__> eglynn: probably yeah
15:37:43 <DinaBelova> eglynn, ts-s! don't tell jd__ about the specs :)
15:37:46 <jd__> DinaBelova did a nice schema to represent that for people interested
15:37:52 * jd__ stares at DinaBelova for the URL
15:38:02 * DinaBelova looking for it
15:38:17 <DinaBelova> https://docs.google.com/a/mirantis.com/drawings/d/1OMqtrgtvWLu_SYEh-g8K0iiIC6lrBWhn8G6KGGIkpS4/edit?usp=drive_web
15:38:17 <eglynn> #link https://docs.google.com/drawings/d/1OMqtrgtvWLu_SYEh-g8K0iiIC6lrBWhn8G6KGGIkpS4/editDinaBelova:
15:38:22 <DinaBelova> :D
15:38:24 <jd__> I'm not sure I'll make a lot of progress in the next days as I've other things on my plate
15:39:05 <jd__> other than that, I'll do a hangout to do a walkabout of the source code for people interested in jumping in
15:39:06 <eglynn> jd__: do you wanna mention that code walk-thru' tenatively planned for monday?
15:39:11 <eglynn> snap!
15:39:25 <jd__> #link https://plus.google.com/events/c7nbeqejlp0ot3lh3trss11meok
15:39:29 <koteswar16> @eglynn: Yes neutron patch. but related to ceilometer labels...
15:39:40 <jd__> so feel free to join
15:40:05 <eglynn> thanks jd__!
15:40:12 <jd__> that's all boss
15:40:14 <DinaBelova> jd__, cool, thanks
15:40:39 <eglynn> #topic Ceilometer sub-sprint at QA/Infra mid-cycle meetup in Darmstadt, Germany
15:40:51 <ildikov> jd__: thanks, this walk-thru is a really good idea!
15:41:04 <eglynn> I mentioned this QA mid-cycle on the channel during the week
15:41:15 <eglynn> ... bringing up here again for completeness
15:41:30 <eglynn> mtreinish floated the idea of using one of the QA/Infra mid-cycle days as a ceilometer testing sub-sprint
15:41:45 <eglynn> #link https://wiki.openstack.org/wiki/Qa_Infra_Meetup_2014
15:41:50 <eglynn> (prolly July 17th or 18th)
15:41:53 <ildikov> eglynn: do we have a deadline to decide?
15:42:05 <eglynn> not a hard deadline
15:42:17 <DinaBelova> ildikov - the thing is we need at least two ceilo ATCs to be there...
15:42:42 <eglynn> exactly ... critical mass >= 2 ceilo folks
15:42:43 <DinaBelova> I hope to attend the Paris event - so I'll have no chance to be in Darmstadt
15:42:49 <DinaBelova> if so
15:42:50 <DinaBelova> :)
15:43:07 <eglynn> so just wanted to throw out the idea on the table so folks can think about it
15:43:14 <ildikov> DinaBelova: well, not impossibly big number at least :)
15:43:25 <DinaBelova> ildikov, yes, for sure :)
15:43:27 <ildikov> eglynn: I may can convince my managers
15:43:43 <eglynn> cool
15:43:50 <DinaBelova> ildikov - if so, please tell me
15:43:55 <ildikov> eglynn: I wanted to catch up with testing anyway, it seems to be an effective way
15:43:56 <eglynn> gimme a shout over the next couple days if anyone else would be interested
15:44:04 <DinaBelova> I'd like to discuss this tempest topic before you'll be there :)
15:44:07 <eglynn> ... it's a bit tentative still
15:44:52 <eglynn> move on?
15:45:02 <koteswar16> @eglynn: can some one approve my change?
15:45:05 <eglynn> #topic Open discussion
15:45:10 <ildikov> DinaBelova: sure, I will use the cat look from Shrek, if nothing else works ;)
15:45:16 <DinaBelova> ;)
15:45:19 <eglynn> koteswar16: we're in a meeting, can it wait?
15:45:31 <koteswar16> ok
15:45:38 <ildikov> koteswar16: check back on the Ceilo channel after the meeting
15:47:20 <gordc> ... i guess we're going to finish on time for once? :)
15:47:31 <eglynn> gordc: LOL :) ... looks like it
15:47:33 <ildikov> gordc: LOL :)
15:47:40 <gordc> sweet!
15:48:31 <eglynn> ... and the world cup doesn't even start for another what, another 4 hours? :)
15:48:45 <ildikov> gordc: we deserve it after the overbooked last 3 or more meetings :)
15:49:14 <ildikov> eglynn: pub chosen or beer already in the fridge at home? ;)
15:49:32 <eglynn> ok that's a wrap ... thanks for a productive meeting
15:49:39 <eglynn> #endmeeting ceilometer