18:00:11 #startmeeting sahara 18:00:12 Meeting started Thu Jun 22 18:00:11 2017 UTC and is due to finish in 60 minutes. The chair is tellesnobrega. Information about MeetBot at http://wiki.debian.org/MeetBot. 18:00:13 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 18:00:15 The meeting name has been set to 'sahara' 18:00:24 hi 18:00:57 o/ 18:02:25 waiting for people to show up 18:02:33 tosky will be here soon 18:02:39 yeah 18:04:15 here I am 18:04:28 #topic News/Updates 18:04:53 I'm working on internal stuff as well as the image gen, CDH is ready for new reviews 18:05:24 #link https://review.openstack.org/#/c/448712/ 18:05:39 apart from the internal stuff, I'm trying to test the current master with Sahara services deployed inside containers using TripleO 18:05:46 (the feature landed few days ago) 18:05:55 other than that, I'm working in iwona on the import and export of templates 18:06:10 I will ask questions later about that 18:06:44 I'm working on a few downstream requests. Some extra config option about proxy_command, some additional sahara-extra auth stuff. should be upstream for this release 18:07:46 Also looking into Vanilla upgrade, but have some mild concerns about it, plus waiting for stable Hadoop 2.8.1 to land 18:08:26 which kind of concerns (or maybe we can talk about them under a separate topic) 18:09:12 mainly timeline concerns, about new CI and the HBase on Vanilla that yingya was working on 18:09:18 a separate topic is probably better 18:09:35 sorry, apparently my internet went down 18:09:38 I'm back now 18:10:07 uh, that may be a problem for closing the meeting (you should regain your identity) 18:10:15 trying 18:10:34 i will probably drop and I will change it later 18:10:40 #chair tosky 18:10:53 that should work 18:10:56 not sure if I can set you as chair so you can close it 18:11:14 you should be good now anyway 18:11:17 you can't set me as chair until you are chair :) 18:11:21 now I'm myself again 18:11:28 :) 18:11:34 I'd suggest to set someone else as chair right now 18:11:43 #chair tosky 18:11:44 Current chairs: tellesnobrega tosky 18:11:45 just in case 18:11:56 now it seems to work 18:11:58 oki 18:12:23 jeremyfreudberg, I missed most of what you said, so anytime you want a new topic to come up let me know and I will set it 18:12:30 sure 18:12:38 did you miss everything i said? 18:12:41 or just some 18:12:54 I just the last line 18:13:14 saying it would be better on another topic 18:13:41 yeah. My main update was "I'm working on a few downstream requests. Some extra config option about proxy_command, some additional sahara-extra auth stuff. should be upstream for this release". But then I want to spend a few minutes talking about logistics of Vanilla plugin upgrade 18:14:04 sounds good 18:14:16 quick topic about PTG 18:14:23 #topic Queens PTG 18:14:36 does anybody has news on being able to attend or not? 18:14:52 most folks aren't here, but we haven't heard from zemuvier 18:15:13 zemuvier, are you planning to attend PTG? does it depend entirely on TSP? 18:15:14 yes, esikachev and I have been sent a request to travel support programm 18:15:35 so I hope we can join this PTG 18:15:36 great, let us know when you get updates 18:15:43 sure 18:15:59 thanks 18:16:08 #topic Documentation Migration 18:16:21 about this, not sure if you guys has a chance to read this spec 18:16:30 #link https://review.openstack.org/#/c/472275/13 18:16:44 Thank you, tellesnobrega 18:16:51 * asettle peaks in 18:16:58 asettle, no worries 18:17:41 basic idea is, project related documentation is being migrated back into project repo, there is a really detailed guideline on the spec on how this is being achieved 18:18:08 I think that's fine by us, I think most of us tend to forget about sahara stuff in openstack-manuals anyway 18:18:13 the goal is to finish phase 1 in pike iirc, (asettle feel free to jump in) 18:18:18 so is it this about the installation/user documentation? Because we already have some documentation (developer) in the repository 18:19:20 tosky: yes :) 18:19:30 it is installation/user/contributors should be on sahara repo and cli info should be in python-saharaclient repo, I do think that we won't have a big problem with this 18:19:37 The openstack-manuals team managers user and operator and contributor info :) 18:19:41 Yeh, you got it tellesnobrega :) 18:20:42 I want to know if anyone of is willing to take the lead on this (making sure it is where it should) 18:20:49 oh, ok; I guess I need to read the spec, but is there something that will be done by the doc team which will have to start with? I mean, will they provide the list of things to be moved, and we moved from there? 18:21:09 or we need to check all the bits that we have inside openstack-manuals? 18:21:14 no problem in both cases, just to know 18:22:03 tosky, it is already described on the spec 18:22:35 ack 18:22:38 time to RTFM 18:23:12 basically yes 18:23:45 for now I will be leading the effort, and if anyone wants to help out let me knoe 18:23:46 know 18:26:01 #topic Vanilla Plugin Upgrade 18:26:04 jeremyfreudberg, you are up 18:26:10 tellesnobrega, great 18:28:03 So as everyone knows, plugin upgrade is high priority for every release. And it has been long time since Vanilla upgrade. I am looking into Hadoop 2.8.x and Spark 2.1.0 on Vanilla plugin for Pike. Some issues are 1) waiting for stable Hadoop 2.8.1 to release 2) getting some artifacts uploaded to sahara-files 3) waiting for new CI and 4) coordinating with Yingya about Hbase on Vanilla 18:28:26 In particular #2 and #3 are good to discuss here 18:28:37 ok 18:29:22 so about #3, I'm waiting for response from red hat to see if we can get resources to deploy the new CI here, having a meeting with my manager soon and will ask if he got any responses 18:29:34 about #2, what artifacts are we talking about? 18:29:53 for #3 there is a possible alternative way: check how much infra resources can we (ab)use with a multinode jobs 18:30:16 Vitaly nicely created a multinode Spark jobs, I suspect that a simple Vanilla jobs may not be too much resource-consuming 18:30:24 tosky, true 18:30:26 tosky, good points 18:30:27 that can't probably scale for CDH or MapR 18:30:32 but Vanilla, maybe 18:31:01 tellesnobrega, about artifacts we definitely need new Oozie and new "Hadoop native libs" 18:31:07 and maybe something else I'm forgetting 18:31:28 tosky, we need to contact infra team to figure that out right? 18:31:35 yep 18:31:55 tosky, I know I ask this a lot to you, but can you ping infra team about that? 18:32:35 I can 18:33:23 tosky, thanks :) 18:33:28 thanks tosky 18:33:45 #action tosky to ping infra about how much resource we can use for vanilla testing on openstack ci 18:34:12 (or push a review with a new a job and see what happens, while trying to look innocent) 18:35:27 tosky, there is always that option 18:35:38 jeremyfreudberg, abour sahara-files, it resides on mirantis right? 18:36:05 yep, it is a mirantis domain pointing to their rackspace cloud storage 18:36:08 jeremyfreudberg, it is still up, probably have to check with zemuvier how to send files there 18:36:33 and if we can expect it to be running for a while 18:36:55 yes, would be good to know. 18:37:08 zemuvier, ^ 18:37:26 yes, i think it's still up, but i'm not sure 18:37:49 i can find it out a little bit later 18:38:01 thanks :) 18:38:06 zemuvier, thanks 18:38:29 #action zemuvier to look into sahara-files and figure out if will be kept running and how to upload new resources to it 18:38:33 zemuvier, sounds good ^ 18:38:34 ? 18:39:05 tellesnobrega: yes, okay :) 18:40:04 thanks 18:40:05 I thought that we already started pushing some resources outside sahara-files (apart from the images, which needs some changes in the storage amount) 18:40:26 iirc we push something to tarballs.openstack.org 18:40:36 actually, tosky has a good point, this stuff is small enough to push to infra-team managed tarballs site 18:40:44 jeremyfreudberg, even better 18:41:21 https://tarballs.openstack.org/sahara/dist/ would be the place 18:41:29 jeremyfreudberg, perfect 18:41:43 #link https://tarballs.openstack.org/sahara/dist/ 18:42:25 so I guess really the question is how to upload to there, and also have some migration plan? 18:44:11 that sounds about right 18:44:27 jeremyfreudberg, I will have you figure that out, sounds good? 18:44:47 sure 18:44:48 just check the history of the sahara jobs in project-config 18:44:54 yep 18:46:59 I believe it's https://review.openstack.org/#/c/367271/ ,fyi 18:47:23 but I will certainly get as much info as I can 18:50:00 that's for the publishing, yes; the build part was already there and you can find it easily from the job names 18:51:40 yep 18:52:08 as it is controlled by the script in sahara-extras, you may not even need a new job 18:52:47 right 18:55:30 tellesnobrega, anything else to discuss? 18:56:03 not from me 18:56:15 oh, just a note 18:56:42 I suggested Telles to create some x.y.z tags at least for Ocata; sahara-image-elements have few changes 18:57:08 makes sense to me 18:57:09 maybe also for Newton (even if the end of phase 2, in one or two months, could be a good time too) 18:57:22 oki :) 18:57:57 nothing else from me 19:00:45 tosky, end the meeting 19:01:31 uh 19:01:34 thanks all! 19:01:39 #endmeeting