*** hvprash has quit IRC | 00:10 | |
*** harlowja has joined #openstack-watcher | 01:35 | |
*** jed56 has quit IRC | 02:05 | |
*** diga has joined #openstack-watcher | 04:04 | |
*** diga has quit IRC | 04:05 | |
*** diga has joined #openstack-watcher | 04:06 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-watcherclient: Updated from global requirements https://review.openstack.org/345158 | 04:10 |
---|---|---|
openstackgerrit | OpenStack Proposal Bot proposed openstack/watcher: Updated from global requirements https://review.openstack.org/339952 | 04:12 |
*** diga has quit IRC | 04:29 | |
*** thorst_ has joined #openstack-watcher | 04:47 | |
*** thorst_ has quit IRC | 05:07 | |
*** thorst_ has joined #openstack-watcher | 05:08 | |
*** thorst_ has quit IRC | 05:25 | |
*** thorst_ has joined #openstack-watcher | 05:41 | |
*** thorst_ has quit IRC | 05:46 | |
*** ecelik has joined #openstack-watcher | 05:56 | |
*** vincentfrancois1 has joined #openstack-watcher | 06:24 | |
*** vincentfrancois1 has quit IRC | 06:46 | |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/watcher-dashboard: Remove discover from test-requirements https://review.openstack.org/345214 | 07:44 |
openstackgerrit | Vincent Françoise proposed openstack/watcher: Refactored the compute model and its elements https://review.openstack.org/339032 | 07:46 |
openstackgerrit | Vincent Françoise proposed openstack/watcher: Added DE Background Scheduler w/ model sync jobs https://review.openstack.org/336032 | 07:46 |
openstackgerrit | Vincent Françoise proposed openstack/watcher: Loadable Cluster Data Model Collectors https://review.openstack.org/333987 | 07:46 |
openstackgerrit | Vincent Françoise proposed openstack/watcher: Merged metrics_engine package into decision_engine https://review.openstack.org/339031 | 07:46 |
openstackgerrit | Vincent Françoise proposed openstack/watcher: Updated DE architecture doc + 'period' param https://review.openstack.org/336033 | 07:46 |
openstackgerrit | Vincent Françoise proposed openstack/watcher: Cluster data model collector plugin documentation https://review.openstack.org/334547 | 07:46 |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/watcher: Remove discover from test-requirements https://review.openstack.org/345215 | 07:47 |
*** danpawlik has joined #openstack-watcher | 07:53 | |
*** thorst_ has joined #openstack-watcher | 08:17 | |
*** thorst_ has quit IRC | 08:21 | |
*** thorst_ has joined #openstack-watcher | 09:04 | |
*** thorst_ has quit IRC | 09:08 | |
*** aspiers has quit IRC | 09:58 | |
*** akijak has joined #openstack-watcher | 10:01 | |
*** aspiers has joined #openstack-watcher | 10:11 | |
*** vincentfrancoise has quit IRC | 10:11 | |
*** akijak has quit IRC | 10:44 | |
*** akijak has joined #openstack-watcher | 10:49 | |
*** vincentfrancoise has joined #openstack-watcher | 10:51 | |
*** aspiers has quit IRC | 10:52 | |
*** aspiers has joined #openstack-watcher | 11:08 | |
*** thorst_ has joined #openstack-watcher | 11:32 | |
*** thorst_ has quit IRC | 11:36 | |
*** vincentfrancoise has quit IRC | 11:41 | |
*** vincentfrancoise has joined #openstack-watcher | 12:15 | |
openstackgerrit | Vincent Françoise proposed openstack/watcher: Fixed Basic optim tempest test https://review.openstack.org/345388 | 12:30 |
*** jed56 has joined #openstack-watcher | 12:52 | |
openstackgerrit | Merged openstack/watcher: Remove discover from test-requirements https://review.openstack.org/345215 | 12:54 |
openstackgerrit | Merged openstack/watcher: Fix dict.keys() PY3 compatible https://review.openstack.org/341946 | 13:02 |
openstackgerrit | Merged openstack/python-watcherclient: Updated from global requirements https://review.openstack.org/345158 | 13:02 |
openstackgerrit | Tomasz Kaczynski proposed openstack/watcher: Add scoring engines to database and API layers https://review.openstack.org/330382 | 13:03 |
*** thorst_ has joined #openstack-watcher | 13:12 | |
*** thorst_ has quit IRC | 13:17 | |
openstackgerrit | Merged openstack/watcher: Updated from global requirements https://review.openstack.org/339952 | 13:29 |
*** ecelik has quit IRC | 13:48 | |
*** hvprash has joined #openstack-watcher | 13:58 | |
*** hvprash has quit IRC | 14:02 | |
*** hvprash has joined #openstack-watcher | 14:03 | |
*** thorst_ has joined #openstack-watcher | 14:36 | |
*** hvprash has quit IRC | 14:45 | |
*** hvprash has joined #openstack-watcher | 14:46 | |
*** hvprash has quit IRC | 14:50 | |
*** diga has joined #openstack-watcher | 14:55 | |
tkaczynski | hi | 15:00 |
vincentfrancoise | hi | 15:04 |
tkaczynski | hi vincent-bot :) | 15:05 |
*** jed56 has quit IRC | 15:05 | |
vincentfrancoise | lol | 15:05 |
tkaczynski | I am just wondering... I will be pushing some next changes related to scoring module soon | 15:05 |
vincentfrancoise | I saw you pushed a new patchset earlier on | 15:06 |
tkaczynski | I plan to also add a sample scoring engine. it could be a real thing and for example use some ML framework | 15:06 |
tkaczynski | (yes, I did - nice that you've noticed) | 15:06 |
vincentfrancoise | with the uuid field id/uuid/name field combo ^^ | 15:07 |
tkaczynski | yes!!! | 15:07 |
tkaczynski | I gave up after hitting the wall with updates/soft deletes | 15:07 |
tkaczynski | anyway, I have a different question: do you think it's a good idea to add some Machine Learning framework to Watcher? | 15:08 |
vincentfrancoise | aren't scoring engines capable of doing some machine learning? | 15:09 |
tkaczynski | for example scipy package. but it's quite large (39 MB compressed) and it's another dependency not strictly needed | 15:09 |
*** thorst_ has quit IRC | 15:09 | |
vincentfrancoise | oh, I believe this is up to the strategy developer to add extra Python dependencies to his strategy if need be | 15:10 |
vincentfrancoise | in his own 3rd party project | 15:10 |
tkaczynski | well, yes :) but they need to be implemented first :) you can implement for example a neural network yourself if you like... or you can use a library which some smart folks already did | 15:10 |
tkaczynski | sure, but then the example scoring engine will be probably very simple and won't use any ML | 15:11 |
vincentfrancoise | yeah but all I'm saying is that this scipy dependecy would lie in the 3rd party alongside the 3rd party strategy and not in watcher | 15:11 |
vincentfrancoise | of course we shouldn't re=invent the wheel | 15:12 |
vincentfrancoise | re-invent | 15:12 |
tkaczynski | kind of like a dummy strategy - just implementing the interface, showing up in the CLI and API | 15:12 |
vincentfrancoise | that being said | 15:12 |
vincentfrancoise | if we want to provide a machine learning based strategy within Watcher | 15:12 |
*** diga has quit IRC | 15:12 | |
vincentfrancoise | then the question of this dependency makes more sense to me | 15:13 |
tkaczynski | yes, but we are not doing it yet. my change is simply creating a framework for plugins, nothing more. at this moment I don't have plans to implement any real strategy using scoring engines / ML | 15:14 |
tkaczynski | sorry, I did say the full truth - I will do that, but as a 3rd party (intel) plugin | 15:14 |
tkaczynski | I was just wondering if anybody would like to see some real scoring engine being built-in in watcher | 15:15 |
tkaczynski | or just a dummy thing doing nothing | 15:16 |
vincentfrancoise | I guess having a fully functioning sample using the scoring engine would make a lot of sense | 15:16 |
*** hvprash has joined #openstack-watcher | 15:16 | |
vincentfrancoise | so yeah maybe you can create another dummy-ish strategy using it then | 15:17 |
tkaczynski | well the dummy one also can be made functional - it can for example calculate the maximum value from a given array ;) then there are no additional dependencies etc. | 15:17 |
tkaczynski | or I could try to come up with some more complicated data model and use a library like scipy to implement it, but the facts are that this one might also not be very useful | 15:18 |
tkaczynski | as creating a good data model is a job on its own and can take months! | 15:18 |
*** thorst_ has joined #openstack-watcher | 15:18 | |
*** hvprash_ has joined #openstack-watcher | 15:19 | |
vincentfrancoise | the only rule for the current dummy is that it should not need to call any external sevice to keep it a simple test case in our integration test | 15:19 |
vincentfrancoise | so maybe you can add a strategy parameter that can turn on a scoring engine functionality in it (that would be deactivated by default) | 15:20 |
*** hvprash has quit IRC | 15:20 | |
tkaczynski | I actually created one more strategy called dummy_with_scorer, which is supposed to use some dummy_scorer - so that the whole thing can be tested and also serve as an example how to implement a strategy using some scoring engine | 15:21 |
vincentfrancoise | sounds good to me then | 15:23 |
tkaczynski | I was just thinking whether there is any expectation for this dummy_scorer to be any "intelligent" | 15:23 |
*** hvprash_ has quit IRC | 15:23 | |
*** thorst_ has quit IRC | 15:23 | |
vincentfrancoise | hmmm | 15:23 |
vincentfrancoise | Did you discuss it yesterday at the midcycle? | 15:23 |
tkaczynski | unfortunately no, maybe I can just ask this question quickly... | 15:24 |
tkaczynski | today | 15:24 |
vincentfrancoise | because I do not personally have a clear answer to this | 15:24 |
tkaczynski | because I think there is no clear answer :) | 15:25 |
vincentfrancoise | jed56 or acabot seem better placed than me on what is expected or not | 15:25 |
tkaczynski | ok, I will try to reach them out. if not today, then some other time | 15:25 |
vincentfrancoise | but IMHO, the more we can show to anyone trying watcher, the better | 15:26 |
tkaczynski | sure, this is my intention. but adding a big dependency always has a cost. who knows, maybe adding this scipy package can cause some unrelated problems for watcher etc. | 15:27 |
vincentfrancoise | At some point | 15:28 |
tkaczynski | this is why it's not a clear winner, because the scoring engine won't be that useful even with that package (I don't have time to work on the data model full time) | 15:28 |
tkaczynski | ... and I'm not a data scientist :) | 15:29 |
vincentfrancoise | we were discussing the eventuality of creating an new repo (openstack or not) that would centralise non-essential plugins that we would support on a best effort basis | 15:29 |
tkaczynski | yeah, maybe that would be a better place | 15:30 |
vincentfrancoise | at least that way we would be able to provide all the plugins we want without having to put too much in the "core" | 15:32 |
vincentfrancoise | but at the time we didn't do it because the effort that represents to maintain plugins in a separate repo was not yet worth it | 15:33 |
*** jed56 has joined #openstack-watcher | 15:35 | |
jed56 | good morning UTC | 15:35 |
vincentfrancoise | hello | 15:36 |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/python-watcherclient: Remove discover from test-requirements https://review.openstack.org/345518 | 15:38 |
*** thorst_ has joined #openstack-watcher | 15:43 | |
*** hvprash has joined #openstack-watcher | 15:53 | |
*** hvprash has quit IRC | 15:54 | |
*** hvprash has joined #openstack-watcher | 15:55 | |
openstackgerrit | Prashanth Hari proposed openstack/python-watcherclient: Add goal_id, strategy_id and host_aggregate CLI options to audit https://review.openstack.org/332982 | 15:56 |
jed56 | oui | 16:04 |
jed56 | Edwin | 16:04 |
*** michaelgugino has joined #openstack-watcher | 16:04 | |
*** vincentfrancoise has quit IRC | 16:44 | |
*** hvprash has quit IRC | 16:50 | |
*** vincentfrancoise has joined #openstack-watcher | 17:17 | |
openstackgerrit | Drew Thorstensen proposed openstack/watcher: Add hacking checks to watcher https://review.openstack.org/345091 | 17:20 |
*** michaelgugino has quit IRC | 17:43 | |
*** harlowja has joined #openstack-watcher | 17:44 | |
*** harlowja has quit IRC | 18:35 | |
openstackgerrit | Tin Lam proposed openstack/watcher: Update docs links to docs.openstack.org https://review.openstack.org/333723 | 18:37 |
*** harlowja has joined #openstack-watcher | 18:38 | |
*** harlowja has quit IRC | 18:59 | |
*** esberglu has joined #openstack-watcher | 19:22 | |
*** jed56 has quit IRC | 19:35 | |
*** wootehfoot has joined #openstack-watcher | 19:36 | |
openstackgerrit | Drew Thorstensen proposed openstack/watcher: Add hacking checks to watcher https://review.openstack.org/345091 | 20:36 |
*** harlowja has joined #openstack-watcher | 20:39 | |
*** thorst_ has quit IRC | 21:26 | |
*** wootehfoot has quit IRC | 21:33 | |
*** thorst_ has joined #openstack-watcher | 21:40 | |
*** harlowja has quit IRC | 21:41 | |
*** thorst_ has quit IRC | 21:45 | |
*** harlowja has joined #openstack-watcher | 21:48 | |
*** harlowja has quit IRC | 21:48 | |
*** thorst_ has joined #openstack-watcher | 21:49 | |
*** thorst_ has quit IRC | 21:53 | |
*** esberglu has quit IRC | 21:54 | |
*** vincentfrancoise has quit IRC | 22:03 | |
*** thorst_ has joined #openstack-watcher | 22:07 | |
*** thorst_ has quit IRC | 22:08 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!