14:00:06 <jeremyfreudberg> #startmeeting sahara
14:00:07 <openstack> Meeting started Thu Oct  3 14:00:06 2019 UTC and is due to finish in 60 minutes.  The chair is jeremyfreudberg. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:00:08 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
14:00:10 <openstack> The meeting name has been set to 'sahara'
14:00:15 <tellesnobrega> o/
14:00:17 <jeremyfreudberg> o/
14:01:32 <tosky> o/
14:01:44 <jeremyfreudberg> #topic news/updates
14:01:59 <tosky> we released RC1
14:02:47 <tosky> the PDF generation has some issues (the text before the TOC and the TOC are swapped), but from the point of view of the goal we could just merge the reviews
14:02:55 <tosky> (still missing the sahara one, but it's almost ready)
14:03:00 <jeremyfreudberg> yup rc1 is out, despite the release team once again not adding me as a reviewer
14:03:08 <tellesnobrega> I'm still working on the python3 bugs, we got mapr, cdh working, have to check ambari, still hanging
14:03:25 <tosky> on the code point of view, tellesnobrega sent out a new version of the Python 3 patches, which improve things when is_proxy_gateway is false
14:03:49 <tosky> jobs are still failing on Ambari/HDP as I discovered yesterday, let's see
14:04:24 <jeremyfreudberg> ok
14:04:37 <jeremyfreudberg> thanks everybody for all that, sorry that i have not much myself
14:04:41 <jeremyfreudberg> #topic python3 status
14:04:45 <tosky> is_proxy_gateway is going to be complicated, but at least we have something better
14:04:54 <jeremyfreudberg> tellesnobrega, how is the oozie bug going?
14:05:09 <jeremyfreudberg> or i mean, the bug involving oozie that we were looking at a couple weeks ago
14:06:25 <jeremyfreudberg> is there a new patchset up dealing with is_proxy_gateway? i don't see it on gerrit
14:09:41 <tosky> no, there is none, I disabled it in the tests: we could just disable it by default in sahara-tests
14:09:51 <tosky> (for now, so that the default tests work)
14:09:56 <jeremyfreudberg> got it
14:10:36 <jeremyfreudberg> i know telles is double-booked, so we can move on from this topic
14:10:58 <jeremyfreudberg> i will try to pitch in as well
14:11:42 <tosky> any help will be super-useful
14:12:03 <tosky> but at least things seems to be mostly working
14:12:19 <jeremyfreudberg> #topic project update shanghai
14:12:29 <jeremyfreudberg> fyi, i will be giving a project update in shanghai
14:12:30 <jeremyfreudberg> https://www.openstack.org/summit/shanghai-2019/summit-schedule/events/24354/sahara-project-update-november-2019
14:13:04 <jeremyfreudberg> let me know if there's something i should emphasize in the update
14:14:07 <tosky> "with the split plugin, every plugin contribution is VERY welcome"
14:14:46 <tellesnobrega> sorry
14:14:49 <jeremyfreudberg> my thoughts: not much activity these days, so i figured i would focus more on "here's what sahara can do, but here's what is missing/broken" rather than try to recap a slow cycle
14:14:50 <tellesnobrega> got distracted
14:14:56 <jeremyfreudberg> tosky: yes, i agree, that's good to mention
14:15:12 <jeremyfreudberg> tellesnobrega, no worries
14:15:16 <tellesnobrega> sounds good
14:15:32 <tellesnobrega> I would emphasize also how python3 is an issue for us
14:15:56 <tellesnobrega> for example the fact that we need plugins to be python3 ready for us to evolve to centos8, rhel8 and so on
14:16:26 <jeremyfreudberg> yeah
14:16:29 <tosky> that also depends on the vendor support (which could be a problem these days), but at least vanilla, storm and spark could be ported
14:16:49 <jeremyfreudberg> python3 on the guests is the tricky part, yes
14:17:45 <jeremyfreudberg> #topic open discussion
14:19:12 <tosky> probably related: I've seen that there are results from the user survey but I didn't analyze them; is there anything interesting from them?
14:19:25 <jeremyfreudberg> yeah, i have the user survey stuff
14:19:27 <jeremyfreudberg> one sec
14:20:35 <jeremyfreudberg> """
14:20:36 <jeremyfreudberg> documentation- cookie cutter solutions
14:20:41 <jeremyfreudberg> no comment
14:20:45 <jeremyfreudberg> Integration with Ohio State University HiBD builds of Hadoop and Spark.
14:20:51 <tosky> o.O
14:20:51 <jeremyfreudberg> Tbd
14:20:59 <jeremyfreudberg> I'd like to get it to work. So- newb admin docs.
14:21:08 <jeremyfreudberg> """
14:21:10 <jeremyfreudberg> that's it
14:21:13 <tosky> oh
14:22:00 <jeremyfreudberg> so 5 answers, 2 about doc, 2 nothings, and 1 interesting one
14:22:55 <tellesnobrega> I like the integration one
14:23:13 <tellesnobrega> do we know who answered that? can we contact them?
14:23:53 <jeremyfreudberg> i think it's anonymous
14:24:48 <jeremyfreudberg> but it is interesting http://hibd.cse.ohio-state.edu/overview/
14:25:50 <tosky> I don't understand if it's a distribution, a set of additional components, a specific configuration/setup for an existing distribution (more than one), or something else
14:27:06 <jeremyfreudberg> i think most of it just a specific way of configuring... but it seems there are some modified components e.g. "RDMA-enhanced HDFS"
14:27:36 <tellesnobrega> looks like it something like YARN
14:28:17 <tellesnobrega> from the architecture it looks like they developed their own yarn to manage hadoop
14:28:50 <jeremyfreudberg> right
14:29:10 <tellesnobrega> but I'm not sure
14:29:25 <jeremyfreudberg> anyway
14:29:28 <jeremyfreudberg> that's it from me today
14:29:40 <tosky> and for me as well
14:30:02 <tosky> I will add the PDF patch for sahara.git as well somewhere in the next days
14:30:13 <tosky> remember that when accepted, they should be backported to train
14:30:13 <jeremyfreudberg> thanks
14:30:17 <jeremyfreudberg> oh, right
14:31:17 <jeremyfreudberg> ok, we can close it
14:31:32 <tosky> thank you all, see you around!
14:32:23 <jeremyfreudberg> #endmeeting