| *** eranrom has joined #openstack-storlets | 07:02 | |
| *** [1]eranrom has joined #openstack-storlets | 08:58 | |
| *** eranrom has quit IRC | 08:58 | |
| *** [1]eranrom is now known as eranrom | 08:58 | |
| kota_ | fyi, i will be absolute from meeting today, sorry. | 09:52 |
|---|---|---|
| kota_ | I have a dinner plan with my friends | 09:53 |
| *** takashi has joined #openstack-storlets | 12:07 | |
| *** takashi has quit IRC | 12:17 | |
| eranrom | kota_,: Have fun :) | 12:19 |
| *** takashi has joined #openstack-storlets | 12:20 | |
| *** takashi has quit IRC | 12:29 | |
| *** takashi has joined #openstack-storlets | 12:34 | |
| eranrom | Hi, anybody here? | 13:00 |
| takashi | Hi :-) | 13:01 |
| eranrom | Takashi: Hi. So I finally got a chance to go over your patches :-) | 13:02 |
| eranrom | Thanks very much for them and apologies for the late review. | 13:02 |
| takashi | eranrom: Thanks a lot for your review! now I have to solve one conflict and after that we can totally merge patches about our first unittest | 13:03 |
| takashi | eranrom: np | 13:03 |
| eranrom | great. i will try to be more responsive this time :-) | 13:03 |
| eranrom | Do yuo have anytyhing in mind planned? | 13:04 |
| eranrom | I mean after those patches? | 13:04 |
| takashi | eranrom: I have some small things like refactoring, but I think I cannot do that so soon | 13:05 |
| eranrom | ok, sure | 13:05 |
| takashi | I'm going to start our performance testing about storlets from this week, so I think I cannot spend so much time for that soon | 13:06 |
| eranrom | oh, I will be VERY interested to see the results :-) | 13:06 |
| eranrom | so far we had a chance to do very little performance testing and we found out the following: | 13:07 |
| eranrom | 1. The storlet daemon thread pool size is crucial when it comes to mabny concurrent requests. | 13:07 |
| eranrom | 2. The size of chunks in which the storlet reads the data from the input stream / write to the output stream is also significant. This is a classical latency / memory trade off... | 13:08 |
| eranrom | s/mabny/many | 13:09 |
| takashi | These are very useful information! I will take care about them in my testing. | 13:10 |
| takashi | I'm going to start with very basic situation, and then change some parameters to see a tendency about the performance of storlets | 13:13 |
| eranrom | One more thing. If you plan on using the identity storlet for this, then it is written in a most non-performant way. For each chunk of data it reads it transforms it into a string replacing \0 with something and logs the data | 13:13 |
| eranrom | We have modified it for performance tests and saw that there is no different between GET Vs. GET with X-Run-Storlet: identitystorlet-1.0.jar | 13:15 |
| eranrom | Sounds good. | 13:15 |
| takashi | eranrom: interesting results | 13:15 |
| takashi | I'm going to use my image processing storlets for testing, like grayscaling, feature detection and so on to test storlets in a something like a more PoC-like way. | 13:17 |
| eranrom | alright, will be interesting to get the results :-) That is if you will be able to share. | 13:17 |
| eranrom | BTW - are you planning on coming to the Hackathon? | 13:18 |
| takashi | eranrom: yes, I and kota_ will be there, and also other two members working about changing policy stuff will. | 13:19 |
| eranrom | great to hear! | 13:19 |
| eranrom | that is to read :-) | 13:19 |
| takashi | I'm now preparing for my buisines trip to Bristol! :-) | 13:20 |
| eranrom | yeah, I need to also start to get prepared. | 13:20 |
| takashi | eranrom: I think we can share some results in our PoC, and I hope we can propose what to improve we find in it. | 13:22 |
| eranrom | That would be great! Looking forward. | 13:22 |
| takashi | eranrom: I wrote some items about resource limitations in wiki as just ideas, but I think we can find if they are really needed throug that PoC. | 13:23 |
| takashi | I'm meaning about discussion points in hackathon, written here. https://wiki.openstack.org/wiki/Meetings/Storlets | 13:24 |
| eranrom | I absolutely agree. Perhaps we will be able to design a solution during the Hackathon. I do not think that this is something the whole community will be interested in. | 13:25 |
| takashi | eranrom: yes | 13:26 |
| takashi | I think the following two topics are what we have to discuss in swift, gate job stuff and fixes in swift | 13:28 |
| takashi | because they need some help and understanding from swift community. | 13:30 |
| takashi | Of cause other topics are also interesting for me :-) | 13:30 |
| eranrom | Agree. BTW - You may want to try and add pleuse as a reviewer to the patch. I do not know how active he is lately but he is the most supportive core to storlets so far... | 13:31 |
| takashi | OK. I'm going to ask him. and again I'm also going to ask kota_ | 13:32 |
| eranrom | great. | 13:33 |
| eranrom | anything else for today? | 13:34 |
| takashi | one thing for Austin | 13:34 |
| eranrom | sure | 13:34 |
| takashi | as I wrote in irc, I modified abstruct a little | 13:35 |
| takashi | eranrom: thank you for your preparing base idea | 13:35 |
| eranrom | sure, yes I saw the change. thanks. In IBM we need to pre-submit talks we want to give to get an approval. So I posted the abstract after your edit. | 13:36 |
| takashi | I'll ask again kota_ about this (because it incluse NTT), but I think we can post that abstract if we have no problem about it. | 13:36 |
| eranrom | BTW - it is always possible to change it before submitting to Openstack | 13:36 |
| takashi | s/incluse/includes | 13:36 |
| takashi | eranrom: I see | 13:37 |
| eranrom | This is an internal IBM thing, and few poeple are seeing this so no worries. | 13:37 |
| eranrom | I will not post anything to openstack before I get your approval. | 13:37 |
| takashi | we have also same kind of things in NTT :-) | 13:38 |
| eranrom | I am not surprized :-)\ | 13:38 |
| eranrom | Has the process started yet? | 13:38 |
| takashi | eranrom: I think we will soon start, but we already asked our managers about this. | 13:39 |
| eranrom | ok. | 13:39 |
| takashi | That's all for me. I'll inform about our updates if we have. | 13:41 |
| eranrom | ok, great. thanks! | 13:42 |
| eranrom | have a good night :-) | 13:44 |
| takashi | eranrom: have a good day :-) | 13:44 |
| eranrom | :-) | 13:48 |
| *** takashi has quit IRC | 13:56 | |
| *** eranrom has quit IRC | 16:14 | |
| *** eranrom has joined #openstack-storlets | 19:25 | |
| *** eranrom has quit IRC | 20:03 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!