| *** thorst has joined #openstack-watcher | 00:07 | |
| *** wootehfoot has quit IRC | 00:22 | |
| *** jwcroppe has quit IRC | 00:41 | |
| *** jwcroppe has joined #openstack-watcher | 00:50 | |
| *** aspiers has quit IRC | 00:54 | |
| *** aspiers has joined #openstack-watcher | 00:56 | |
| *** thorst has quit IRC | 02:20 | |
| *** thorst has joined #openstack-watcher | 02:21 | |
| *** thorst has quit IRC | 02:29 | |
| *** thorst has joined #openstack-watcher | 02:35 | |
| *** thorst has quit IRC | 02:37 | |
| *** thorst has joined #openstack-watcher | 03:38 | |
| *** thorst has quit IRC | 03:46 | |
| *** thorst has joined #openstack-watcher | 04:44 | |
| *** thorst has quit IRC | 04:51 | |
| *** ecelik has joined #openstack-watcher | 05:38 | |
| *** thorst has joined #openstack-watcher | 05:49 | |
| *** thorst has quit IRC | 05:57 | |
| *** jwcroppe has quit IRC | 06:51 | |
| *** thorst has joined #openstack-watcher | 07:14 | |
| *** acabot_ has joined #openstack-watcher | 07:14 | |
| *** acabot_ has quit IRC | 07:15 | |
| openstackgerrit | Edwin Zhai proposed openstack/python-watcherclient: Enable strategy parameter https://review.openstack.org/297557 | 07:22 |
|---|---|---|
| *** thorst has quit IRC | 07:22 | |
| openstackgerrit | Edwin Zhai proposed openstack/watcher: Enable strategy parameters https://review.openstack.org/297556 | 07:23 |
| *** danpawlik has joined #openstack-watcher | 07:26 | |
| *** vincentfrancoise has joined #openstack-watcher | 07:34 | |
| *** apoorv has joined #openstack-watcher | 07:43 | |
| *** jwcroppe has joined #openstack-watcher | 07:56 | |
| *** jwcroppe has quit IRC | 08:04 | |
| *** alexchadin has joined #openstack-watcher | 08:11 | |
| *** apoorv has quit IRC | 08:18 | |
| *** thorst has joined #openstack-watcher | 08:20 | |
| *** dtardivel has joined #openstack-watcher | 08:22 | |
| *** thorst has quit IRC | 08:27 | |
| *** jed56 has joined #openstack-watcher | 08:45 | |
| * acabot is preparing the agenda | 08:46 | |
| *** apoorv has joined #openstack-watcher | 08:58 | |
| alexchadin | hi | 09:19 |
| jed56 | hiu | 09:22 |
| vincentfrancoise | hi | 09:22 |
| alexchadin | I integrate watcher on testing cluster | 09:24 |
| alexchadin | which includes two types of hypervisors: KVM, VMware | 09:25 |
| *** thorst has joined #openstack-watcher | 09:25 | |
| alexchadin | I don't want to take VMware host into account when using strategies | 09:25 |
| vincentfrancoise | wouldn't cause migration issues if you have different kinds of hypervisors? | 09:25 |
| alexchadin | vincentfrancoise: yes, It would | 09:25 |
| alexchadin | I propose to add config option or something else | 09:26 |
| alexchadin | to specify which hosts we get from get_all_hypervisors() function | 09:26 |
| vincentfrancoise | shouldn't we also specify the hypervisor type in the model ? | 09:26 |
| alexchadin | Yes, we should | 09:27 |
| vincentfrancoise | and then the only thing left to do would be to filter out the VMware hypervisors | 09:27 |
| alexchadin | will we add it to upstream? | 09:29 |
| jed56 | alexchadin: if you don't wants to | 09:30 |
| jed56 | take into account some hypervisors you should specify that in the 'audit scope' | 09:30 |
| vincentfrancoise | https://blueprints.launchpad.net/watcher/+spec/define-the-audit-scope ? | 09:30 |
| jed56 | https://blueprints.launchpad.net/watcher/+spec/define-the-audit-scope | 09:30 |
| *** thorst has quit IRC | 09:32 | |
| jed56 | alexchadin: IMHO, we should only change the action 'migrate' | 09:32 |
| jed56 | in most of the cases, the strategy don't care that the hypervisor is KVM or Vmware | 09:33 |
| alexchadin | jed56: that's it, but it tries to collect ceilometer info from vmware host | 09:33 |
| alexchadin | which doesn't have it | 09:34 |
| jed56 | This is the responsibility of the 'Action' to manage heterogeneous metrics | 09:34 |
| jed56 | s/metrics/hypervisors | 09:34 |
| jed56 | alexchadin: what do you mean ? | 09:34 |
| alexchadin | jed56: when I launch sd-strategy, it gets all hypervisors and its statistics per host | 09:35 |
| alexchadin | we don't have statistics from vmware host | 09:35 |
| jed56 | you specify new plugin in ceilometer :) | 09:36 |
| jed56 | by the way, did you have the time to look at monasca or gnocchi ? | 09:37 |
| alexchadin | I didn't:( | 09:38 |
| alexchadin | I will look them this evening, right? | 09:38 |
| alexchadin | *okay | 09:39 |
| jed56 | alexchadin: thanks | 09:42 |
| jed56 | did you understand by point of view regarding the metrics ? | 09:42 |
| alexchadin | should we use define-the-audit-scope or change the action 'migrate'? | 09:44 |
| *** vincentfrancoise has quit IRC | 10:22 | |
| *** alexchad_ has joined #openstack-watcher | 10:23 | |
| *** alexchadin has quit IRC | 10:25 | |
| *** thorst has joined #openstack-watcher | 10:29 | |
| *** thorst has quit IRC | 10:38 | |
| *** alexchad_ has quit IRC | 10:40 | |
| openstackgerrit | Alexander Chadin proposed openstack/watcher: Add fix for __init__() error https://review.openstack.org/323784 | 10:40 |
| *** alexchadin has joined #openstack-watcher | 10:40 | |
| *** hvprash has joined #openstack-watcher | 10:42 | |
| *** hvprash has quit IRC | 10:42 | |
| *** hvprash has joined #openstack-watcher | 10:43 | |
| *** hvprash has quit IRC | 10:47 | |
| *** alexchadin has quit IRC | 11:16 | |
| jed56 | alexchadin : in your particular case you should modify migrate | 11:30 |
| jed56 | use | 11:30 |
| *** thorst has joined #openstack-watcher | 11:41 | |
| *** apoorv has quit IRC | 11:49 | |
| openstackgerrit | Alexander Chadin proposed openstack/watcher: Add fix for __init__() error https://review.openstack.org/323784 | 11:58 |
| *** jwcroppe has joined #openstack-watcher | 12:00 | |
| *** jwcroppe has quit IRC | 12:05 | |
| acabot | agenda for today https://wiki.openstack.org/wiki/Watcher_Meeting_Agenda#06.2F01.2F2016 | 12:08 |
| *** vincentfrancoise has joined #openstack-watcher | 12:11 | |
| *** hvprash has joined #openstack-watcher | 12:15 | |
| *** hvprash has quit IRC | 12:15 | |
| *** openstackgerrit has quit IRC | 12:18 | |
| *** openstackgerrit has joined #openstack-watcher | 12:18 | |
| danpawlik | Hello guys, I can tell you, that puppet-watcher module is in review: https://review.openstack.org/#/c/323839/ | 12:31 |
| *** danpawlik has quit IRC | 12:40 | |
| *** danpawlik has joined #openstack-watcher | 12:40 | |
| vincentfrancoise | danpawlik: awesome! | 12:41 |
| acabot | danpawlik : looks great ! thanks a lot ! | 12:53 |
| danpawlik | acabot: thanks. I must abandon this review and create new, because I should push first commit with files which are generated by cokkiecutter and then I can add my own files | 12:57 |
| acabot | I saw that ;-( | 12:59 |
| *** hvprash has joined #openstack-watcher | 13:12 | |
| hvprash | acabot_ et al. Congrats ! Great Job for having us in big tent | 13:20 |
| vincentfrancoise | hvprash: Hooray! That's quite a big achievement :) | 13:23 |
| hvprash | yes indeed ! Saw only this morning.. catching up from long weekend | 13:24 |
| vincentfrancoise | hvprash: same goes for us! That was quite the news when we arrived at the office :) | 13:25 |
| hvprash | the team rocks :) | 13:25 |
| vincentfrancoise | true thing :) | 13:26 |
| *** jwcroppe has joined #openstack-watcher | 13:35 | |
| *** seanmurphy has joined #openstack-watcher | 13:37 | |
| acabot | hvprash : thx ! | 13:40 |
| hvprash | thx to you guys :) | 13:40 |
| acabot | I hope it will help you to get more resources from Walmart on the project ;-) | 13:41 |
| *** brunograz has joined #openstack-watcher | 13:42 | |
| hvprash | acabot, i am trying hard to get resources for this project. Hoping to have some good news in the coming weeks | 13:43 |
| *** ecelik has quit IRC | 13:48 | |
| acabot | ok | 13:49 |
| *** alexchadin has joined #openstack-watcher | 13:52 | |
| *** esberglu has joined #openstack-watcher | 13:57 | |
| danpawlik | acabot: I have create new pull request: https://review.openstack.org/#/c/323864/ :) Now is only generated files using puppet-openstack bootstrap. Problem is, that this tool was not recently updated and I must "fix" initial commit xD | 13:58 |
| acabot | lol | 13:59 |
| acabot | I updated the agenda ;-) | 13:59 |
| *** ostroverkhov has joined #openstack-watcher | 14:05 | |
| *** zarkone has joined #openstack-watcher | 14:42 | |
| zarkone | hello all! Struggling with a watcher-decision-engine: for some reason, after I do `watcher audit-create`, decision-engine console remains silent even in debug.. what I've missed? | 14:43 |
| vincentfrancoise | zarkone: the watcher CLI just got overhauled last week | 14:44 |
| vincentfrancoise | so the command changed a bit | 14:44 |
| vincentfrancoise | you can refer to https://factory.b-com.com/www/watcher/doc/watcher/deploy/user-guide.html to see the new commands | 14:45 |
| vincentfrancoise | if you just type in "watcher" | 14:45 |
| vincentfrancoise | you should also enter the watcher prompt with command auto-completion ;) | 14:45 |
| zarkone | vincentfrancoise: thanks, but I have to use the 0.22 and corresponding watcher-client right now.. So, on my test env I see how decision engine create action plan, but on production env -- not.. Seems like something is different in config, but I can't catch what exactly | 14:46 |
| zarkone | I can't wait till I could upgrade to >=0.26, by the way =) | 14:46 |
| zarkone | but because of Liberty deps I can't do it right now | 14:47 |
| vincentfrancoise | oh I see | 14:47 |
| *** lrensing has joined #openstack-watcher | 14:47 | |
| vincentfrancoise | can you make a pastebin out of the exact command you are typing then? Maybe I can help | 14:48 |
| *** seanmurphy has quit IRC | 14:59 | |
| tpeoples | jed56: what is this proof of concept you're talking about? | 15:01 |
| *** brunograz has quit IRC | 15:01 | |
| *** alexchadin has quit IRC | 15:01 | |
| gzhai2 | vincentfrancoise: any question for strategy parameter check? | 15:01 |
| jed56 | tpeoples: basically, the POC retrieve the request_spec of an instance. | 15:01 |
| jed56 | Then, we can specify in the requestSpec a "requested_destination" (https://review.openstack.org/#/c/314509/10/nova/scheduler/host_manager.py) which have been computed by watcher. | 15:02 |
| jed56 | Finally, we can call select_destinations(), if the requested_destination satify the scheduler rules, the requested_host is returned otherwise the exception NoValidHost is raise. | 15:02 |
| jed56 | There is an issue with this solution | 15:02 |
| vincentfrancoise | gzhai2: basically, we currently use voluptuous to validate parameters | 15:02 |
| jed56 | We need to apply directly the migration, otherwise Nova is not aware of this change. | 15:02 |
| gzhai2 | vincentfrancoise: same in my code. | 15:02 |
| jed56 | If we call again nova for validate the next action the previous one is not taking into account. | 15:02 |
| tpeoples | jed56: hmmm. have you discussed that with bauzas? | 15:03 |
| vincentfrancoise | gzhai2: but in your case, we need to serialize the voluptuous Schema to save in the DB so it can be used by the Watcher API when the operator submits its inputs | 15:03 |
| jed56 | tpeoples: yes, I spend 25 minutes with him today | 15:03 |
| *** seanmurphy has joined #openstack-watcher | 15:03 | |
| jed56 | there are many bugs in nova :) | 15:03 |
| vincentfrancoise | gzhai2: so the solution would be for us to use jsonschema to perform the validation so we can pass the schema from the decision engine down to the API | 15:04 |
| jed56 | for example : we an affinity rules you can't migrate any VMs | 15:04 |
| jed56 | with | 15:04 |
| gzhai2 | vincentfrancoise: Yes. As end user need read schema first before submitting parameter, right? | 15:04 |
| jed56 | IMHo, one solution can be to have a specific session with the nova scheduler with a kind of virtual cluster state which take into account the changes. | 15:04 |
| vincentfrancoise | gzhai2: BUT that means that a plugin developer will have to use voluptuous for strategy parameters but voluptuous for actions | 15:05 |
| vincentfrancoise | gzhai2: so 2 libs for the same thing is not good | 15:05 |
| jed56 | tpeoples with powerSystem you are only performing one action ? | 15:05 |
| jed56 | if you use select_destination() | 15:05 |
| jed56 | right ? | 15:06 |
| vincentfrancoise | gzhai2: the idea would be not just to read but to make the API validate the parameters based on the schema | 15:06 |
| tpeoples | jed56: we only use live migrations currently | 15:06 |
| tpeoples | but... yes | 15:06 |
| tpeoples | just one at a time | 15:06 |
| gzhai2 | vincentfrancoise: both are voluptuous, why 2 libs? | 15:06 |
| jed56 | tpeoples: okay so in your case its working | 15:07 |
| gzhai2 | vincentfrancoise: What's the benefit of API validation? | 15:07 |
| vincentfrancoise | gzhai2: no jsonschema is different from voluptuous | 15:07 |
| vincentfrancoise | gzhai2: things should be easy for the operator | 15:07 |
| gzhai2 | vincentfrancoise: jsonschema for actions, right? | 15:07 |
| vincentfrancoise | gzhai2: no for strategy parameters ;) | 15:08 |
| gzhai2 | vincentfrancoise: I can propagate the exception, so API can return error. | 15:08 |
| vincentfrancoise | gzhai2: so if he's typing an invalid parameter for his strategy | 15:08 |
| gzhai2 | is it okay? | 15:08 |
| vincentfrancoise | gzhai2: the error would only be caught be seen upon triggering an audit | 15:08 |
| vincentfrancoise | gzhai2: I'll submit my reviews tomorrow so it will be clearer for you to understand my point | 15:09 |
| tpeoples | jed56: Do you think at some point you could try to summarize what you find on a ML thread so everyone is on the same page? | 15:09 |
| gzhai2 | yes. as "-p" is appended to 'audit create' | 15:09 |
| gzhai2 | " BUT that means that a plugin developer will have to use voluptuous for strategy parameters but voluptuous for actions. so 2 libs for the same thing is not good" | 15:10 |
| jed56 | tpeoples: yes, of course. I will first delve more in nova | 15:10 |
| gzhai2 | not fully understand it. both are voluptuous, but 2 libs. | 15:11 |
| vincentfrancoise | gzhai2: jsonschema is not the same as voluptuous (https://pypi.python.org/pypi/jsonschema vs https://pypi.python.org/pypi/voluptuous/0.8.11) | 15:13 |
| vincentfrancoise | the structure of the schema dict is formatted differently | 15:13 |
| *** ostroverkhov has quit IRC | 15:14 | |
| gzhai2 | vincentfrancoise: pls. upload your review. So I can check. Thank you. | 15:16 |
| *** hvprash_ has joined #openstack-watcher | 15:16 | |
| gzhai2 | vincentfrancoise: I agree that API error is good for invalid parameter, but propergate exception can achieve it. | 15:17 |
| gzhai2 | vincentfrancoise: BTW, do you agree that the only way to specify strategy paramter is appending "watche audit create"? | 15:19 |
| *** hvprash has quit IRC | 15:20 | |
| *** danpawlik has quit IRC | 15:22 | |
| vincentfrancoise | gzhai2: sorry I was afk | 15:46 |
| vincentfrancoise | gzhai2: you could potentially specify audit parameters in the audit template if and only if you have specified the strategy within it. | 15:47 |
| vincentfrancoise | gzhai2: For now, I would argue we should keep it simple and only expose the parameters at the audit level as you said | 15:48 |
| *** ostroverkhov has joined #openstack-watcher | 15:52 | |
| *** seanmurphy has quit IRC | 16:09 | |
| *** ostroverkhov has quit IRC | 16:24 | |
| *** vincentfrancoise has quit IRC | 16:54 | |
| *** zarkone has quit IRC | 17:21 | |
| *** wootehfoot has joined #openstack-watcher | 17:48 | |
| *** esberglu has quit IRC | 18:27 | |
| *** dtardivel has quit IRC | 19:10 | |
| *** wootehfoot has quit IRC | 19:39 | |
| *** hvprash_ has quit IRC | 20:50 | |
| *** lrensing has quit IRC | 21:09 | |
| *** ostroverkhov has joined #openstack-watcher | 21:47 | |
| *** thorst has quit IRC | 22:23 | |
| *** thorst has joined #openstack-watcher | 22:30 | |
| *** thorst has quit IRC | 22:34 | |
| *** thorst has joined #openstack-watcher | 22:50 | |
| *** ostroverkhov has quit IRC | 22:52 | |
| *** thorst has quit IRC | 22:54 | |
| *** jwcroppe has quit IRC | 22:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!