08:00:22 #startmeeting storlets 08:00:23 Meeting started Tue Sep 13 08:00:22 2016 UTC and is due to finish in 60 minutes. The chair is eranrom. Information about MeetBot at http://wiki.debian.org/MeetBot. 08:00:24 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 08:00:26 The meeting name has been set to 'storlets' 08:00:35 Hi 08:00:39 Hi 08:01:08 Congrats for our first official meeting :-) 08:01:24 takashi: Do you know it Kota plans on joining? 08:01:29 eranrom: yes! :-) 08:02:09 eranrom: I don't know. 08:02:18 takashi: ok, so lets start 08:02:27 #topic python update 08:02:30 eranrom: maybe we need to ping him in storlets channel 08:02:39 takashi: good idea. 08:03:31 eranrom: I think we can go ahead. I already shared the current status about python storlet work to him. 08:04:05 takashi: ok, sure. So I see that the next step is the StorageFile calss. 08:04:19 I will review 08:04:25 That is: 08:04:43 #action eranrom to review Add StorletFile class: https://review.openstack.org/#/c/367560/ 08:05:22 eranrom: thanks 08:05:45 takashi: Do you want to land the doc patch and do the Application doc in a follow up? 08:06:26 eranrom: IMO it is better to write doc based on that StorletFile interface 08:06:35 if we do not have big objections on it 08:06:40 #agreed 08:07:05 so I'd like to land StorletFile class first, and submit a doc to depend on that change 08:07:23 takashi: sure. anything else on the topic? 08:08:11 eranrom: no big other things now. After we land doc changes, I'll work about remaining items listed on the python-storlet etherpad 08:09:06 takashi: ok, great. I will move to the next topic then. 08:09:16 #topic bit tent work 08:09:36 First, thanks for the Java coding style patch 08:09:53 I guess its high time we added a style check for java 08:10:10 eranrom: ++ 08:10:29 Still, I guess we first need to replace the build.xml with a pythonic build 08:10:31 it was not so hard work to replace tabs as expected, because I can use sed for that :-) 08:10:51 eranrom: agree 08:11:38 takashi: right, the thing is, there was a mixture of spaces and tabs with IMO sometimes 8 spaces per tab and sometimes 4 - agrrrr 08:12:45 Also there is 367477 which IMO will be the next step 08:13:06 367477 Create storlets package 08:13:17 * eranrom acting as patchbot 08:14:01 eranrom: I'm drafting some patches to integrate all build stuffs into setup.py 08:14:05 This one https://review.openstack.org/#/c/367477/ 08:14:14 and this one https://review.openstack.org/#/c/368177/ 08:14:42 IMO, we can integrate buiding/installing of c/java module to setup.py using Extentions 08:15:17 takashi: I thought Extensions only support c, but will recheck 08:15:49 eranrom: I still need to check that, or at least I think we can kick some script, maybe. 08:15:59 If indeed Extensions support c only, there is another trick to extend the default behavior of the setup process to add arbitrary functionality 08:16:13 eranrom: yes 08:16:49 I think it does not take so much time to create the setup.py mechanism itself, 08:17:08 but I need more time to update ansible playbook based on that. 08:17:57 takashi: what do you have in mind regarding the ansible part? 08:19:34 eranrom: I'll first create a framework with single setup.py, and after that I'll try to address how we should update current ansible scripts 08:20:01 eranrom: At that time I'd like to ask you comments/help 08:20:23 takashi: ok, gotcha. So actually you are taking the setup.py action item :-) 08:21:23 eranrom: I'll submit a draft of setup.py first, which at least passes unit tests (maybe updated version of 367477) 08:21:39 takashi: ok great thanks. 08:21:52 * eranrom looking for something else to do. Ah - spark-storlets 08:22:40 takashi: Will be looking out for the setup.py and review. 08:22:43 Thanks! 08:22:59 talking about ansible, we still have another big one 08:23:14 functional tests on swift/keystone master 08:24:11 EOL for Liberty is coming soon (when Newton is released), and at least we need to migrate to Mitaka or later 08:24:28 takashi: right. The change itself is changing a single line of code in the storlet-swift-install repo. 08:24:55 #action eranrom to make that change and see all hell breaks loose 08:25:03 Is there anything we need to do for keystone v3 before that migration? 08:25:13 keystone v3 API 08:26:10 takashi: Well, since keystone is backward compatible, we can start with Keystone master using v2 auth API and then migrate to V3 API 08:26:23 eranrom: ok 08:26:39 I'm just afraid we need to finish that work before the migration because I tried it and found it may take some time for me... :-( 08:26:47 takashi: I will need to update joss in between to support V3 API so that spark-storlets does not break 08:27:10 eranrom: great to hear that 08:27:27 takashi: you mean that you tried Keystone master with v2 API and it did not work? 08:28:28 eranrom: Akihito tried it and failed to run ansible scripts, because v2 API is disabled. I'm currently supposing he missed some configration to turn on v2. 08:28:52 v2 API 08:29:07 takashi: could be. ok Let me do this in 2 steps (with a third one that follows): 08:29:15 1. Update to swift master 08:29:24 2. update to keystone master 08:29:40 That is keystone master with v2 API 08:29:51 3. update joss / keystone V3 API 08:29:55 eranrom: makes sense 08:30:30 takashi: next topic? 08:30:40 eranrom: ok 08:30:48 #topic java code style 08:31:45 I do not have much to say on the topic, other then it would be good to introduce so as not to loose the work on the tab expansion 08:32:12 which can be overriden by mistake if we do not have a stlyle checker 08:32:54 I will try to make progress on this next week 08:33:34 eranrom: totally agree 08:33:55 takashi: ok, anything else? 08:34:02 #topic open discussion 08:35:17 eranrom: As I added to the agenda, I think we need to care about long existing patches 08:36:16 mainly I'm little bit warried about installation in docker patch, which exists long time on gerrit 08:37:00 takashi: right. We had a problem were I could not run this on my VM, and it took quite a while till be overcome all problems 08:37:13 In fact I spent a lot of time yesterday and today to 08:37:22 ignore last line 08:37:32 Doron and I spent a lot of time finding this. 08:37:44 that is overcoming this problem 08:38:12 Today I uploaded an updated patch, and Doron has fixed merge problems... 08:38:27 So hopefully it will land soon. 08:38:35 Thanks very much for bringing this up. 08:38:45 Looking at the other two. 08:39:14 eranrom: please ping me if you need some review 08:39:24 takashi: sure, thanks 08:39:41 about the other two things, I'll ask kota_'s plan. 08:40:21 takashi: sure. Myimpression was that they are still W.I.P but please let me know is I got it wrong. 08:40:56 If we start working about packaging, it may cause so may merge conflict on existin items 08:41:05 s/may/many 08:41:35 so I'd like to land things we can merge first, if we only have small improvements remaining. 08:41:46 takashi: right. Good point! 08:42:25 eranrom: I'll have a meeting with kota_ this week, so will ask him there. 08:43:03 takashi: ok please update me, in the meantime I will work on reviewing and landing all other stuff that AFAIK is not W.I.P and is not in conflict. 08:43:44 eranrom: ok, thanks 08:44:00 takashi: Thanks for bringing up this topic 08:44:51 takashi: anything else for today? 08:44:51 eranrom: :-) 08:45:29 eranrom: no 08:45:43 I still need to update design summit etherpad, sorry. 08:46:11 I think I can take some time for that next week 08:46:17 takashi: that's ok. Its not that urgent 08:46:35 takashi: great. 08:46:56 Thanks for joining (our first official meeting) 08:47:20 See you on #openstack-storlets 08:47:32 eranrom: thank you 08:47:37 #endmeeting