15:00:10 #startmeeting monasca 15:00:11 Meeting started Wed Jan 13 15:00:10 2016 UTC and is due to finish in 60 minutes. The chair is rhochmuth. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:00:12 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:00:14 o/ 15:00:14 The meeting name has been set to 'monasca' 15:00:19 0/ 15:00:22 o/ 15:00:23 o/ 15:00:41 hello 15:00:45 Agenda is at, https://etherpad.openstack.org/p/monasca-team-meeting-agenda 15:00:47 o/ 15:00:53 Hello 15:00:54 Agenda for Wednesday January 13, 2016 (15:00 UTC) 15:00:54 1. Outdated changes, should they be abandoned or taken care of ? 15:00:54 1. https://review.openstack.org/#/c/234449/ 15:00:54 2. https://review.openstack.org/#/c/150620/ 15:00:54 2. Healtcheck approach - decision, based on https://review.openstack.org/#/c/249685/, check the last comment 15:00:54 3. Pull requests for ansible roles 15:00:54 4. Alarm count resource, https://review.openstack.org/#/c/257607/ 15:00:55 5. Sorting alarms, https://review.openstack.org/#/c/260697/ 15:00:55 6. Enhance dimension filtering, https://review.openstack.org/#/c/266509/ 15:00:56 7. monasca-log-api: 15:00:56 1. Security update, https://review.openstack.org/#/c/256404/ 15:00:57 8. Other reviews 15:01:07 Indenting got lost in that agenda 15:01:22 hi qwebirc46365 15:01:43 :) 15:01:46 o/ 15:01:47 So, there is a lot to go through today 15:01:55 mainly reviews 15:02:01 hi 15:02:18 some have been sitting there for a while due to holidays and other things 15:02:28 so, if someone has more agenda items 15:02:33 please add to the list 15:02:52 #topic outdated changes 15:03:03 https://review.openstack.org/#/c/234449/ 15:03:30 So, I don't think that the original author will be resolving that 15:03:38 he is no longer on the project 15:03:54 however, it looks like he fixed a bug 15:04:07 we were waiting on unit tests 15:04:13 but they were never completed 15:04:30 i think someone on the monasca project will need to take ownership for this one 15:04:38 i don't want to just abandon it 15:04:47 so, are there any volunteers 15:05:02 if not, i can try and get looked at here 15:05:08 but not guarantees 15:05:17 I could have a look 15:05:27 thanks bmotz 15:05:34 I could take a look too 15:05:44 thanks witek 15:05:44 I want try too 15:05:44 me too, but been pretty booked recently, so also can't promise it, maybe at least I will do a review 15:06:05 I'm happy to defer to witek or shinya_kwbt :) 15:06:13 :) 15:06:23 so many....maybe a person who takes this sooner should leave a comment saying: 'It's mine....do not touch :)' 15:06:24 :) 15:07:19 ok, i'll get bmotz and witek figure it out 15:08:27 So, the next review that could use some attention is, https://review.openstack.org/#/c/150620/ 15:08:41 this one was also submitted by a deloper that is no longer working on monasca 15:09:01 we had a discussion there but the change is over 3 months old and I am pretty much not sure if it fits anymore or if is needed anyway 15:09:29 so, do we want to abandon this one 15:09:35 it isn't too important 15:09:46 yea, let's abondon it 15:09:57 +1 15:09:59 +1 15:10:00 +1 15:10:07 actually...-2 ;D 15:10:14 lol 15:10:33 just a quick joke...;-) 15:10:38 OK, "abandon" button hit 15:10:46 review is now abandoned 15:10:57 that was easy 15:11:05 too easy :-) 15:11:15 #topic healthcheck 15:11:24 tomasz, i think this is you 15:11:42 https://review.openstack.org/#/c/249685/ 15:12:00 i couldn't tell from the comments, exactly what the proposal was 15:12:01 basically I've made an investigation some time ago and would love to get some feedback for the last comment in that change 15:12:44 one thing was not established or covered (doing it as filter via oslo.middleware or separate endpoint) 15:12:47 i'm not sure i understand the comments 15:13:14 can your provide more details and discuss 15:13:56 basically, it is possible to run embedded gunicorn with healthcheck only, but it has to be done in separate process (otherwise actual API can't start) 15:14:11 if done that way, turning everything off is problematic 15:14:45 there's a bunch of exceptions coming from multiprocess library 15:14:48 by embedded gunicorn, does that mean gunicorn gets included in teh api, as an import? 15:15:38 it means that you basically run another WSGI app from within API by having a hook on pre or post start event from gunicorn 15:16:26 for me it just look really cumbersome and makes everything hard to understand 15:17:32 so, do you want to add this, or is your recommendatino to not add 15:18:20 I think it is worth adding, it accomplishes one thing, if healthcheck cannot respond that means API is down 15:18:27 tomasztrebski: why not just having an api endpoint in the same process, e.g. /v2/healthcheck? 15:19:01 tomasztrebski: so a LB can ping that endpoint periodically 15:19:33 tomasztrebski: it will be better than the middleware that is always performed for every request 15:20:15 I think adding a separate endpoint is actually a way to go, it has not been implemented in this change, because I was waiting to cover it at the meeting 15:20:28 fabiog seems to enjoy the idea 15:20:31 ") 15:20:33 :) 15:20:51 i was just looking at the comment stream 15:20:52 and basically one advantage, if you think about it, is that we have more control over what we want to return 15:21:11 i think txv had some comments related to trying to run this seperately 15:21:15 tomasztrebski: yes, this is simple and it avoids that you think the API is healthy because a "ghost" process is the only thing is running 15:21:21 tomasztrebski, fabiod: I like the idea of separate endpoint for healthcheck too, as that would give a good logical separation 15:21:45 because in filter (at least with oslo.middleware) you know nothing about HTTP method, so no possibility to run lean healthcheck for HEAD or more complex for GET requests 15:21:46 endpoint +1 15:21:48 so, it sounds like we are reaching concensus 15:22:02 tsv: separated means a new URL that runs in the same process of all the other URLs 15:22:26 basically, we would add a new "resource" in falcon terminology for healtcheck 15:22:26 hmm, so it seems like I got it all wrong :/ 15:22:41 i don't think you got it wrong 15:22:52 fabiog: sure, but a separate endpoint could be turned on/off with different access control too right ? 15:22:57 i think you did a lot of the analysis and research 15:23:05 and it didn't work out in the end 15:23:09 that's ok 15:23:11 ;-) 15:23:23 tsv correct 15:23:26 tsv: yes, only some users can access that 15:23:37 tsv: for instance services like LB 15:23:40 but we don't have rbac either 15:23:59 ok 15:24:03 so, how about for now, we do the simple thing 15:24:12 meaning to say ? 15:24:21 rhochmuth: I will work on RBAC for python ... don't know when .. but I did it before :-) 15:24:38 thanks fabiog 15:25:02 so, tomasz, i think you are all clear to do the simple thing and add a healtcheck resource 15:25:16 +2 15:25:22 I think I can live with that approach :D [+2] 15:25:30 all in favor +2 15:25:42 +2 15:26:02 are there any other openstack services that implement healtcheck resources 15:26:02 +2 15:26:05 +2 15:26:26 just trying to understand a little more if there is any prior method in place 15:26:37 seems like it might be of general utility 15:26:46 gosh, I though I was trying to figure that one out and by that I've found oslo.middleware 15:26:57 ahh, i see 15:27:04 something you might find in, say, oslo 15:27:27 it has some built-in mechanism that just plug-in in configuration and here is goes 15:27:40 + base class to create new healthchecks 15:27:46 nod 15:28:22 well, at the risk of not doing what has been done before 15:28:32 i think we've all approved the new healthcheck 15:28:49 sounds like we should continue with the next topic 15:28:52 thanks tomasz 15:29:07 rhochmuth: tomasztrebski: there are discussions of getting rid of WSGI in openstack, if that is the case our solution will be longer term 15:29:38 #topic pull requests for ansible roles 15:30:03 tomasz, is this also yours? 15:30:11 there is a bunch of pull requests for ansible roles which are waiting some time already 15:30:16 mine 15:30:55 can you send me a link of the repos, and i'll take a look 15:31:07 sorry, i've lost track this past 4 weeks a bit 15:31:08 \notice fabiog do you mean, that WSGI is to be replaced with something something else 15:31:22 now, or offline? 15:31:29 offline 15:31:32 ok 15:31:36 thanks 15:31:37 thanks 15:31:59 some tips for future to make the process better? 15:32:12 tomasztrebski: I heard rumors that they want to change, but for now it is not clear with what and when 15:32:42 witek: just ping us directly if no one is looking at your changes 15:32:47 soon enough 15:33:01 is mailing list a good place? 15:33:04 the ansible repos are managed outside of gerrit 15:33:11 sure, that would work too 15:33:20 that is probably better 15:33:33 nice 15:33:41 ok, that's all 15:33:48 thanks 15:33:55 #topic alarms count resource 15:33:56 https://review.openstack.org/#/c/257607/ 15:34:20 so, rbrandt has been busy adding some new resources and query parameters 15:34:53 the alarms count resource adds the ability to get the counts of alarms in various conditions 15:35:10 as well as filter them various ways 15:35:37 the main usage is on overview/summary pages 15:35:47 previousely, you would need to query and get all alarms 15:36:00 and then do all your own grouping and counting client side 15:36:12 with 10,000s of alarms the performance was dropping 15:36:39 and if paging needed to be done that would further increase the latency 15:37:02 so, i'm just soliciting feedback for rbrandt 15:37:11 i've looked at the code and done some testing on it 15:37:20 so left to my own, i would approve 15:37:36 but wanted to make sure everyone new what was in provess and agreed with the changes... 15:38:10 rhochmuth: I know it would be a bigger change, but wouldn't it be better to dynamically keep the count when alarms are created or deleted or fire? 15:38:13 there is also a related question about hibernate support too, and whetehr that is necessary for approval 15:38:26 rhochmuth: and then it will be a really simple and fast query 15:38:50 keep the state in the api? 15:39:24 i don't think that is going to necessarily work well 15:39:24 maybe we need a count for all resources? 15:39:47 the queries that you would like to apply aren't known ahead of time 15:39:55 so, you would have to keep everytyhing in memory 15:39:56 rhochmuth: no, I got it I think it works as I was expecting 15:40:22 ddieterly, a count resource would be useful on other resources too 15:40:23 I'd prefer querying DB, at least you always make sure that in given point of time returned number reflects the reality 15:40:28 but right now, we are trying to limit 15:40:34 the amount of work 15:40:53 tomasz: i agree 15:40:55 sure, be for future, it would be good to keep the resources consistent 15:42:17 so, my goal is to review this change, and assuming some other reviewers +1, then I would like to get this merged in this week 15:42:34 or as soon as all issues are resoloved 15:43:05 There is the related rewivew at, https://review.openstack.org/#/c/260697/ 15:43:33 one thing was not answered - is hibernate implementation needed to approve that ? 15:44:00 i would say no 15:44:33 that would leave this functionality unsupported if hubernate is use 15:44:36 is used 15:44:59 i'm assuming that all the existing resources query parameters, …, would wrok 15:45:09 but the new functionality would be unsupported 15:45:39 so, if a query to the counts resourse was done, and hibernate wasnt' implmeneted yet, then it would fail 15:45:49 but, i'm assuming that we aren't breaking anything 15:45:55 have to check if we can plan some resources for that 15:46:16 so, are you ok with the above statements 15:46:20 that i'm making 15:46:57 basically, as far as hibernate, we wouldn't break anything, but new features might not work, until implementatino is completed 15:47:39 just throw notImplemented at first 15:47:44 correct 15:48:00 we'll need to test this ourselved 15:48:03 ok with me 15:48:10 awesome, thanks! 15:48:32 you're welcome :) 15:48:37 rbrandt will test to ensure we didn't break it 15:48:39 I will try to test too. 15:48:52 thanks shinya 15:49:16 :) 15:49:34 so, i'm not going to list all the reviews that rbrandt has in flight, but they are all related to the goal of improving the performance in user-interfaces 15:49:52 and as a result, they all invovle some new functionality 15:50:23 but, we're being careful to not break anything that is already implemented 15:50:33 rhochmuth: also we have the python-client requirements patch that hit another wall. Apparently all the oslo library moved and the update on the keystone client is not enough 15:50:34 https://review.openstack.org/#/c/251674/ 15:50:47 just put us as reviewers for hibernate related changes 15:50:59 ok 15:50:59 by user-interfaces you mean horizon/monasca-ui? 15:51:26 well, i mean any ui, that ends up using the new resources 15:51:40 we are not using any of these new resources in horizon yet 15:51:45 ok 15:51:47 but those would be great to add 15:52:36 so, we've basically done a lot of the pre-work to enable a lot of improvmeents in the monasca-ui 15:53:15 fabiog: yes the liberty branches moved 15:53:29 joe keen was telling me that they proabbly resolved a bug 15:53:44 in the process they bumped versions on some libraries, either keystone or osl 15:53:47 i can't recall 15:53:52 rhochmuth: so do you think that bumping up the versions in the client will not create issues? 15:53:57 i believe it was a big bump, like a major version 15:54:16 rhochmuth: I can do a simple test, update and see if jenkins builds it 15:54:20 we were hoping to take the miniaml route 15:54:32 and bump versions 15:54:41 to whatever liberty is at again 15:54:54 but, it will take a couple of days is what i was told 15:55:05 and need to be prioritzed on my team 15:55:08 rhochmuth: ok, that is not a problem 15:55:20 you might touch-base with joe 15:55:30 i don't know if you or someone on your team can resolve 15:55:33 rhochmuth: ok, I will 15:55:46 joe put in about two weeks prior to xmas, and then this happened 15:55:59 fabiog: ok, thanks! 15:56:23 sorry about this, but openstack is turning out to be more moving than expected 15:56:48 we beleive we need to start making branches, but would like to do that at mitaka 15:57:26 tomasz: i don't think we are going to cover your security changes to the log api 15:57:32 as we are running out of time 15:57:36 i left some comments 15:57:55 we're definitely quite keen on starting some stable branches at some stage 15:57:58 so, hopefully we can resolve y commenting in gerrit and possibly also cover next week 15:58:29 bmotz: yes, i think we convinced ourselves we need branches 15:58:43 so, for mitaka we'll need to discuss 15:58:49 we can discuss it next week, in the meantime I will cover your comments 15:58:54 thanks 15:59:09 so, we've run out of time 15:59:19 don't forget we are still plannin on remote mid-cycle 15:59:38 on wed/thurs feb 3rd and 4th 15:59:45 we should start working on an agenda 16:00:03 hopefully i got those dates correct 16:00:10 ok, we've run out again 16:00:11 rhochmuth: yes 16:00:14 thanks everyone 16:00:16 okj, so see you next time ;-) 16:00:21 bye 16:00:24 bye 16:00:25 bye 16:00:34 #endmeeting