Tuesday, 2014-08-19

*** elmiko is now known as _elmiko01:02
*** alazarev has quit IRC01:21
*** shakamunyi has joined #openstack-sahara01:33
*** witlessb has joined #openstack-sahara01:56
*** witlessb has quit IRC02:01
*** Krast_ has quit IRC02:26
*** Krast has joined #openstack-sahara02:26
*** shakayumi has joined #openstack-sahara03:07
*** shakamunyi has quit IRC03:09
*** shakayumi has quit IRC03:10
*** tmckay has quit IRC03:37
*** ViswaV has joined #openstack-sahara04:01
*** xianghuihui has quit IRC04:03
*** ViswaV_ has joined #openstack-sahara04:03
*** xianghuihui has joined #openstack-sahara04:03
*** ViswaV has quit IRC04:05
*** shakamunyi has joined #openstack-sahara04:07
*** ViswaV has joined #openstack-sahara04:08
*** ViswaV_ has quit IRC04:10
*** xianghuihuihui has joined #openstack-sahara04:15
*** xianghuihui has quit IRC04:18
*** xianghuihuihui has quit IRC04:20
*** xianghui has joined #openstack-sahara04:21
*** Krast has quit IRC05:08
*** shakamunyi has quit IRC05:13
*** k4n0 has joined #openstack-sahara05:36
*** Krast has joined #openstack-sahara06:14
*** Krast has quit IRC06:28
*** tnovacik has quit IRC06:48
*** Longgeek has joined #openstack-sahara07:26
*** ViswaV has quit IRC07:47
*** witlessb has joined #openstack-sahara07:58
*** Longgeek has quit IRC08:04
*** Longgeek has joined #openstack-sahara08:05
*** Longgeek has quit IRC08:06
*** Longgeek has joined #openstack-sahara08:06
*** tnovacik has joined #openstack-sahara08:10
*** julienvey has joined #openstack-sahara08:17
openstackgerritNikita Konovalov proposed a change to openstack/sahara-dashboard: Repository cleanup  https://review.openstack.org/11449808:19
*** Krast has joined #openstack-sahara08:22
*** LoveLife has joined #openstack-sahara08:42
*** Longgeek has quit IRC08:42
*** Longgeek has joined #openstack-sahara08:43
openstackgerritAndrey Pavlov proposed a change to openstack/sahara: Add tests for ops.py  https://review.openstack.org/11521508:47
*** Longgeek has quit IRC08:47
*** Longgeek has joined #openstack-sahara08:49
*** skolekonov has joined #openstack-sahara09:13
openstackgerritA change was merged to stackforge/sahara-ci-config: Refactoring localrc  https://review.openstack.org/11498209:23
openstackgerritA change was merged to stackforge/sahara-ci-config: Remove unused parameter SSH_USERNAME from configs  https://review.openstack.org/11326209:40
openstackgerritA change was merged to stackforge/sahara-ci-config: Enable pig job for Hadoop 2.4.1  https://review.openstack.org/11502609:40
openstackgerritYaroslav Lobankov proposed a change to openstack/sahara: The first test for Vanilla 1.2.1 in Tempest style  https://review.openstack.org/11503309:44
*** tosky has joined #openstack-sahara09:52
openstackgerritAlexander Ignatov proposed a change to openstack/sahara: Correction of words decoMMiSSion-decoMMiSSioning  https://review.openstack.org/11523210:16
*** witlessb has quit IRC10:16
*** witlessb has joined #openstack-sahara10:17
*** julienvey has quit IRC10:18
*** Longgeek has quit IRC10:24
*** julienvey has joined #openstack-sahara10:29
*** Longgeek has joined #openstack-sahara10:53
*** LoveLife has quit IRC11:03
openstackgerritSergey Reshetnyak proposed a change to openstack/sahara: Fix using cinder volumes with nodemanager in HDP2  https://review.openstack.org/11524711:23
*** Longgeek has quit IRC11:26
*** Longgeek has joined #openstack-sahara11:26
openstackgerritYaroslav Lobankov proposed a change to openstack/sahara: The first test for Vanilla 1.2.1 in Tempest style  https://review.openstack.org/11503311:58
openstackgerritKazuki OIKAWA proposed a change to openstack/sahara-specs: [EDP] Hive works with Swift (vanilla1 plugin)  https://review.openstack.org/11525911:59
*** Krast has quit IRC12:02
openstackgerritKazuki OIKAWA proposed a change to openstack/sahara-specs: [EDP] Hive works with Swift (vanilla1 plugin)  https://review.openstack.org/11525912:12
*** ylobankov has quit IRC12:38
*** miqui has joined #openstack-sahara13:19
*** _elmiko is now known as elmiko13:29
*** tmckay has joined #openstack-sahara13:45
*** tmckay has left #openstack-sahara13:46
openstackgerritMichael McCune proposed a change to openstack/sahara-specs: Updating EDP Swift trust authentication spec  https://review.openstack.org/11359113:51
*** tmckay has joined #openstack-sahara13:52
*** Networkn3rd has joined #openstack-sahara14:15
*** shakamunyi has joined #openstack-sahara14:16
tmckayaignatov, yoohoo, are you there? :)14:20
aignatovtmckay: yes14:20
aignatovhi14:20
tmckayhi.  I wondered what you thought about my Ooozie/iptables spec.  Should we do something in Sahara automatically, or just write documentation?14:20
tmckayI could go either way.14:21
tmckayI have also been thinking that in K or L we might be able to move toward using Mesos as a scheduler for hadoop jobs.  That might alleviate some of the issues with the Oozie console.14:22
aignatovtmckay: I like this solution as most secure way to restrict all acccess from all hosts but now I think that it could be some inconvinience for end users… probably we could have an option which allowed host we can add to iptables rules…14:27
aignatovin sahara configs14:27
aignatovneed more thoughts from other community members14:28
tmckayaignatov, yes, exactly.   I am thinking that oozie host (127.0.0.1) and Sahara host (management ip) are always allowed, and a user can add others in a list14:28
tmckayaignatov, okay, so in general you +1 a software solution instead of just documentation that says "hey, you can do this on the master node .... "14:29
aignatovyes, with an ability to give an access for end hosts I’m basically ok with such changes14:29
tmckaythat's the question I'm debating.  Because, today, someone with current Sahara could do the same thing by hand and plug up Oozie.14:29
tmckayokay.  One more thing I have to read up on -- how hard/easy is it to spoof an ip?  Because the ultimate solution is Sahara using ssh to run oozie CLI, and only localhost has access14:30
tmckaybut that's really locked down14:30
tmckayaignatov, thank you, I will add config options to the spec and how I think it will work, and what the iptables rules will look lie14:31
tmckaylike14:31
*** shakamunyi has quit IRC14:32
aignatovok, probbaly this topic is a good candidate for design track - “Sahara&Hadoop@& security” - probably two time slots will be required :)14:38
tmckayaignatov, sounds good14:42
*** shakamunyi has joined #openstack-sahara14:47
*** tnovacik_ has joined #openstack-sahara14:54
*** tnovacik has quit IRC14:54
*** skolekonov has quit IRC15:03
SergeyLukjanovtmckay, aignatov, and several days on pods :)15:09
aignatovyep15:09
tmckayyes15:10
tmckayI suppose another solution here (blocking access to Oozie) is to not give the oozie server host a floating ip15:11
tmckayThen, you can only get there from the Sahara host and other nodes in the cluster, right?15:12
tmckayelmiko, ^^ I think you were referring to this the other day15:12
*** Networkn3rd has quit IRC15:12
elmikotmckay: something similar15:13
elmikoalso, alazarev referenced the security group method, on the spec15:13
tmckayoh, cool, I'll take a look15:13
*** Networkn3rd has joined #openstack-sahara15:15
tmckayI wonder if we should go with simple iptables first, and then try ssh/CLI as a second pass15:17
elmikotmckay: +1 for iptables now solution15:18
elmikoi think we can refactor for something more complicated/configurable on the next pass15:18
openstackgerritDenis Egorenko proposed a change to stackforge/sahara-ci-config: Temporary set jobs with Vanilla 2.4 non-voting  https://review.openstack.org/11531615:20
*** IvanBerezovskiy has left #openstack-sahara15:50
*** Timotey has quit IRC15:56
*** tnovacik_ is now known as tnovacik15:58
*** rhodgin has joined #openstack-sahara16:03
openstackgerritA change was merged to stackforge/sahara-ci-config: Temporary set jobs with Vanilla 2.4 non-voting  https://review.openstack.org/11531616:30
openstackgerritArtem Osadchiy proposed a change to openstack/sahara: MapR plugin implementation  https://review.openstack.org/11339116:54
*** ViswaV has joined #openstack-sahara16:55
*** ViswaV has quit IRC16:55
*** ViswaV has joined #openstack-sahara16:56
*** ViswaV has quit IRC16:56
*** elmiko is now known as mimccune17:38
*** mimccune is now known as elmiko17:39
*** shakamunyi has quit IRC17:39
*** shakamunyi has joined #openstack-sahara18:11
openstackgerritSergey Reshetnyak proposed a change to stackforge/sahara-ci-config: Revert "Temporary set jobs with Vanilla 2.4 non-voting"  https://review.openstack.org/11537118:30
*** shakamunyi has quit IRC18:30
*** tosky has quit IRC18:30
*** Networkn3rd has quit IRC18:31
*** shakamunyi has joined #openstack-sahara18:44
*** julienvey has quit IRC18:48
*** Longgeek has quit IRC19:06
openstackgerritA change was merged to openstack/sahara: Fix starting instances after scaling for CDH  https://review.openstack.org/11287719:06
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Made EDP engine plugin specific  https://review.openstack.org/11472119:14
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Added create_hdfs_dir method to oozie edp engine  https://review.openstack.org/11511519:14
tmckayalazarev, are automatic security groups for Sahara being implemented for Juno?19:26
*** akuznetsov has quit IRC19:41
*** Networkn3rd has joined #openstack-sahara19:51
*** julienvey has joined #openstack-sahara20:10
*** shakamunyi has quit IRC20:46
*** miqui has quit IRC20:49
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Moved URI getters from plugin SPI to edp_engine  https://review.openstack.org/11540020:51
*** ViswaV has joined #openstack-sahara21:08
*** tellesnobrega has quit IRC21:11
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Moved URI getters from plugin SPI to edp_engine  https://review.openstack.org/11540021:14
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Moved get_oozie_server from plugin SPI to edp_engine  https://review.openstack.org/11540321:14
*** tellesnobrega has joined #openstack-sahara21:14
*** rhodgin has quit IRC21:27
*** alazarev has joined #openstack-sahara21:39
*** elmiko is now known as _elmiko21:44
openstackgerritTrevor McKay proposed a change to openstack/sahara-specs: Add a config option to block the Oozie server port  https://review.openstack.org/11511321:47
*** ViswaV_ has joined #openstack-sahara21:49
*** ViswaV has quit IRC21:52
*** julienvey has quit IRC21:53
*** julienvey has joined #openstack-sahara21:59
*** tmckay has quit IRC22:15
*** Networkn3rd has quit IRC22:38
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Do not rely on hash ordering in tests  https://review.openstack.org/11273622:46
*** ViswaV_ has quit IRC22:47
*** julienvey has quit IRC22:53
*** shakamunyi has joined #openstack-sahara23:02
*** alazarev has quit IRC23:06
*** alazarev has joined #openstack-sahara23:07
*** shakamunyi has quit IRC23:18
*** julienvey has joined #openstack-sahara23:24
*** julienvey has quit IRC23:28
*** shakamunyi has joined #openstack-sahara23:33
*** witlessb has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!