Thursday, 2014-08-21

*** tongli has quit IRC02:12
*** craigbr has quit IRC03:29
*** garyh has quit IRC04:10
*** garyh has joined #openstack-monasca04:34
*** craigbr has joined #openstack-monasca04:50
*** craigbr has quit IRC04:54
*** craigbr has joined #openstack-monasca04:55
*** aviau has quit IRC10:40
*** aviau has joined #openstack-monasca10:52
*** mikedillion has joined #openstack-monasca11:18
*** mikedillion has quit IRC11:35
*** craigbr has quit IRC13:12
*** openstackgerrit has quit IRC13:21
*** craigbr has joined #openstack-monasca13:42
*** openstackgerrit has joined #openstack-monasca13:58
openstackgerritA change was merged to stackforge/monasca-agent: Remove hardcoded version  https://review.openstack.org/11546814:06
*** tongli has joined #openstack-monasca14:11
sandywalshadded some new screencasts to the playlist: Notigen event templates and EOD .exists processing14:20
sandywalshhttps://www.youtube.com/playlist?list=PLmyM48VxCGaW5pPdyFNWCuwVT1bCBV5p314:20
*** dschroeder has joined #openstack-monasca14:39
*** cindyo has joined #openstack-monasca15:00
*** mikedillion has joined #openstack-monasca15:05
sandywalshcindyo: not quite sure of your question? One set of rules per pipeline (triggering criteria), but that one ruleset could be responsible for thousands of active streams15:25
sandywalshcindyo: https://github.com/StackTach/sandbox/blob/master/oahu_config.py#L22-L25 is one pipeline definition15:27
sandywalshand https://github.com/StackTach/sandbox/blob/master/oahu_config.py#L31-L35 is the other (for example)15:27
cindyosandywash: db_expiry_check in the inmemory driver vs mongodb_driver has a different number of parms.  Which one should I be using just to see how it works?15:38
cindyoit seems like only mongodb one will work, since the pipeline is the one sending those parms15:39
cindyosandywalsh: thanks for the links, that is helpful.  the integration test was my guide and it was not matching the event request id key15:43
sandywalshcindyo: sorry, I didn't get back to the inmemory driver to fix it up yet.15:46
sandywalshonly mongo right now15:46
sandywalshI'll try and get to that shortly ... working on stackforge headaches :/15:47
cindyocindyo: no problem, I realize it’s in development, so it’s nice of you to help us to understand :)  Good luck on the stackforge integration :)15:48
sandywalshheh, thanks ... I'll need it. Let me know if you run into any more issues15:48
sandywalshthe new screencast might be useful too15:49
cindyowhat is the link for the screencast?15:52
*** mikedillion has quit IRC15:58
tongli@sandywalsh, will someone send an agenda out for next week meetings?15:58
*** mikedillion has joined #openstack-monasca16:00
cindyosandywalsh: I get a connection failure to mongo. I guess I have to figure out how to setup a mongdo db16:16
cindyoor can I just change my version of the inmemory db to have the same number of parms?16:18
cindyoi’ll look into that, because i think we want to go the inmemory way16:19
sandywalshcindyo: the big limitation is the workers don't work with in-memory (since it would span N in-memory instances)16:30
sandywalshcindyo: I'd need to change it to use shared memory or something16:31
cindyowas thinking of using the streams (in-memory?) to calculate the amount of time from beginning to end and generate a metric with the delta time.  Not sure how you normally store this stream of data though16:36
cindyowe would have pipeline processing per tenant, so the same worker would always get that tenant data to add to its pipeline16:40
openstackgerritTim Kuhlman proposed a change to stackforge/monasca-thresh: Create a tar.gz file with the package target.  https://review.openstack.org/11603816:49
sandywalshcindyo: that's a possibility, key off tenant_id and request_id.16:51
cindyoyeah, then the memory sharing is not a concern16:52
kuhlmantI'm getting an error trying to compile monasca-api.16:56
kuhlmant[ERROR] /Users/kuhlmant/src/monasca/api/src/test/java/com/hpcloud/mon/infrastructure/persistence/mysql/AlarmMySQLRepositoryImplTest.java:[50,7] error: class AlarmMySqlRepositoryImplTest is public, should be declared in a file named AlarmMySqlRepositoryImplTest.java16:56
kuhlmantAny ideas on what is wrong?16:56
kuhlmantkuhlmant@mac:~/src/monasca/api (master)$ java -version16:57
kuhlmantjava version "1.7.0_25"16:57
kuhlmantJava(TM) SE Runtime Environment (build 1.7.0_25-b15)16:57
kuhlmantJava HotSpot(TM) 64-Bit Server VM (build 23.25-b01, mixed mode)y16:57
sandywalshcindyo: well, the expired, ready and purge workers wouldn't work. Unless we explicitely call those operations in the yagi handler or add_event()16:57
craigbrkuhlmant: You have a capitalization problem16:57
craigbrWeird thing about a mac is filenames are case insenstive16:58
cindyooh those are separate workers, then there is a memory sharing problem16:58
kuhlmantHmm, so what do I do about it?16:59
craigbrI will help you after standup16:59
sandywalshcindyo: but I think there is a hack workaround we can do16:59
cindyoi’m sure we’ll talk about some of this next week, but our goal was per tenant metrics from streams16:59
kuhlmantOh wait Cindy isn't talking about my issues, capitilization I will try and fix.17:00
cindyohaha!17:00
sandywalshcindyo: I'll try and get some time tomorrow to fix that stuff up. Nearly have stackforge done17:01
cindyohow is the communication between mongo db and the expired, ready, and purge workers implemented?17:03
cindyomongo db streams17:04
openstackgerritTim Kuhlman proposed a change to stackforge/monasca-api: Added a tar ball to the package target  https://review.openstack.org/11604117:04
openstackgerritDavid Schroeder proposed a change to stackforge/monasca-agent: Fix detection and operation of Kafka plugin  https://review.openstack.org/11012417:13
sandywalshcindyo: they all talk to the same mongodb17:15
sandywalshthe streams are stored there17:15
*** tong_ has joined #openstack-monasca17:23
*** tongli has quit IRC17:26
cindyosandywalsh: do the workers poll the db?17:34
cindyochecking for ready, etc17:34
sandywalshcindyo: yes17:34
*** tongli has joined #openstack-monasca17:48
*** tong_ has quit IRC17:52
*** mikedillion has quit IRC18:05
*** mikedillion has joined #openstack-monasca18:28
*** mikedill_ has joined #openstack-monasca18:32
*** mikedillion has quit IRC18:33
*** mikedill_ has quit IRC18:34
*** mikedillion has joined #openstack-monasca18:36
*** mikedillion has quit IRC19:05
*** mikedillion has joined #openstack-monasca19:08
*** tongli has quit IRC19:10
*** cindyo has quit IRC19:29
*** cindyo has joined #openstack-monasca19:35
cindyosandywalsh: what would I pass in for the “chunk” parameter to pipeline calls?19:53
sandywalshanything is fine (like 100) https://github.com/StackTach/sandbox/blob/master/oahu_config.py20:12
cindyosandywalsh: thanks, sandbox is a good source i see for examples :) will try using mongodb20:17
cindyosandywalsh: I had 634 streams, it says it checked 100 and none were ready.  Is the chunksize the number of streams it checks?  I want to force them ready but don’t know how. I tried this:  p.process_ready_streams(100,now)20:28
cindyosandywalsh: I think I had the parameters reversed!20:32
cindyohmmm maybe not, the pipeline code has this:  def process_ready_streams(self, chunk, now=None), but sandbox tests have the reverse20:33
*** cindyo has quit IRC22:27
*** cindyo has joined #openstack-monasca22:31
*** craigbr has quit IRC22:58
*** craigbr has joined #openstack-monasca22:59
*** craigbr has quit IRC23:03
*** cindyo has quit IRC23:16
*** dschroeder has quit IRC23:27

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!