Tuesday, 2015-08-11

*** elmiko_ has joined #openstack-sahara01:03
*** elmiko has quit IRC01:06
*** melaks has quit IRC01:10
*** elmiko_ has quit IRC01:11
*** elmiko has joined #openstack-sahara01:20
*** coolsvap_ has joined #openstack-sahara01:24
*** coolsvap_ has quit IRC01:36
*** elmiko_ has joined #openstack-sahara01:48
*** elmiko_ has quit IRC01:51
*** elmiko has quit IRC01:52
*** hdd has quit IRC03:39
*** logan2 has quit IRC03:47
*** logan2 has joined #openstack-sahara03:55
*** hdd has joined #openstack-sahara04:11
*** hdd has quit IRC04:17
*** hdd has joined #openstack-sahara04:19
*** hdd has quit IRC04:24
*** hdd has joined #openstack-sahara04:24
*** hdd has quit IRC04:31
*** hdd has joined #openstack-sahara04:31
*** Poornima has joined #openstack-sahara04:45
*** hdd has quit IRC04:49
*** david-lyle has joined #openstack-sahara04:50
*** hdd has joined #openstack-sahara04:58
*** Nikolay_St has quit IRC05:38
*** melaks has joined #openstack-sahara05:38
*** melaks has quit IRC05:50
*** hdd has quit IRC05:52
*** vgridnev has joined #openstack-sahara05:54
*** melaks has joined #openstack-sahara05:55
*** vgridnev has quit IRC06:00
*** vgridnev has joined #openstack-sahara06:09
*** melaks has quit IRC06:10
*** melaks has joined #openstack-sahara06:18
*** melaks has quit IRC06:29
*** vgridnev has quit IRC06:52
*** esikachev has joined #openstack-sahara07:11
*** vgridnev has joined #openstack-sahara07:56
*** esikachev has quit IRC08:12
*** links has joined #openstack-sahara08:13
*** esikachev has joined #openstack-sahara08:20
*** sgotliv has joined #openstack-sahara08:27
*** sgotliv has quit IRC08:27
*** sgotliv has joined #openstack-sahara08:28
*** melaks has joined #openstack-sahara08:29
*** esikachev has quit IRC08:56
openstackgerritAndrey Pavlov proposed openstack/sahara-specs: Addding spec for Objects update support in Sahara API  https://review.openstack.org/20837808:57
*** melaks has quit IRC09:02
*** esikachev has joined #openstack-sahara09:09
*** tosky has joined #openstack-sahara09:17
*** Nikolay_St has joined #openstack-sahara09:18
openstackgerritAndrey Pavlov proposed openstack/sahara-specs: Addding spec for Objects update support in Sahara API  https://review.openstack.org/20837809:24
*** esikachev has quit IRC09:47
*** vgridnev has quit IRC09:56
*** ylobankov__ has joined #openstack-sahara09:56
*** ylobankov_ has quit IRC09:56
*** vgridnev has joined #openstack-sahara09:57
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding job_execution_update api call  https://review.openstack.org/19791410:04
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding job_execution_update api call  https://review.openstack.org/19791410:07
openstackgerritlu huichun proposed openstack/sahara: [EDP] Add suspend_job() for sahara edp engine(oozie implementation)  https://review.openstack.org/20144810:15
openstackgerritAndrey Pavlov proposed openstack/sahara: Formatting and mounting methods changed for ironic  https://review.openstack.org/20048310:23
*** esikachev has joined #openstack-sahara10:23
openstackgerritSergey Reshetnyak proposed openstack/sahara: [WIP] New version of HDP plugin  https://review.openstack.org/18429210:53
openstackgerritSergey Reshetnyak proposed openstack/sahara: New version of HDP plugin  https://review.openstack.org/18429210:54
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add API methods for call verifications, DB table  https://review.openstack.org/19671311:04
openstackgerritlu huichun proposed openstack/python-saharaclient: Add job execution update  https://review.openstack.org/20800111:21
*** saneax has joined #openstack-sahara11:23
*** coolsvap has quit IRC11:50
*** coolsvap has joined #openstack-sahara11:51
*** openstackgerrit_ has joined #openstack-sahara12:02
*** saneax has quit IRC12:17
*** saneax has joined #openstack-sahara12:18
*** saneax has quit IRC12:30
*** egafford has joined #openstack-sahara12:32
*** ylobankov__ is now known as ylobankov12:34
*** saneax has joined #openstack-sahara12:34
*** links has quit IRC12:48
*** _crobertsrh is now known as crobertsrh12:50
*** openstackgerrit_ has quit IRC12:51
*** openstackgerrit_ has joined #openstack-sahara12:56
openstackgerritYanis Guenane proposed openstack/puppet-sahara: Use openstack/ namespace for fixtures modules  https://review.openstack.org/21155912:56
*** elmiko has joined #openstack-sahara13:05
elmikois sahara ci hosed?13:06
pino|work"morning people, how are you? is the sahara ci facing issues currently?"13:10
*** tmckay has left #openstack-sahara13:10
elmikopino|work, pretty much. i have a patch that's been waiting 11 hours for ci ಠ_ಠ13:12
*** tmckay has joined #openstack-sahara13:13
tellesnobregahey guys, anyone care to take a look at https://review.openstack.org/#/c/203067/ ?13:29
*** vgridnev has quit IRC13:33
*** vgridnev has joined #openstack-sahara13:34
*** vgridnev has quit IRC13:34
*** david-lyle has quit IRC13:36
*** crobertsrh has left #openstack-sahara13:40
tellesnobregai'm not sure if there are any new people here wanting to use sahara but htruta wrote a realy nice tutorial on how to submit hadoop jobs using sahara python client http://henriquetruta.com/mapreduce-job-sahara-python/13:41
htrutatellesnobrega: o/13:42
*** crobertsrh has joined #openstack-sahara13:43
tellesnobregaelmiko: when using hadoop + swift in sahara, when a job starts hadoop brings pieces of data from swift just like hdfs?13:46
openstackgerritTrevor McKay proposed openstack/sahara: Add manila nfs data sources  https://review.openstack.org/20961513:47
openstackgerritTrevor McKay proposed openstack/sahara: Support manila shares as binary store  https://review.openstack.org/20469013:47
openstackgerritTrevor McKay proposed openstack/sahara: Allow Sahara native urls and runtime urls to differ for datasources  https://review.openstack.org/20963413:47
tmckaysigh13:47
tellesnobregatmckay: you probably know that ^13:49
elmikotellesnobrega, well, it grabs whatever object you specify13:49
elmikoor writes to it13:49
tmckaytellesnobrega, yes, I believe so.  It serializes objects from swift13:49
tmckaybut I don't know a lot of detail about it13:50
tmckayI know I had issues with swift/spark because one of the serialization classes broke, and we needed a different JAR13:50
*** openstackgerrit_ has quit IRC13:55
tellesnobregaelmiko: ok, so my questions is more on the direction of, does it bring the whole file at once or fetchs in small pieces?13:55
*** openstackgerrit_ has joined #openstack-sahara13:56
elmikotellesnobrega, well, on the swift end, a GET request is made and then the file is sent back13:56
elmikoi'm not sure exactly what is being done inside the hadoop-swift jar, but at the lowest level that is how it will work13:56
elmikoit should be the whole file, although it might take time to download and i'm not sure how the jar decides to buffer that.13:57
*** vgridnev has joined #openstack-sahara13:57
openstackgerritlu huichun proposed openstack/python-saharaclient: Add job execution update  https://review.openstack.org/20800113:57
*** vgridnev has quit IRC13:58
*** saneax has quit IRC14:00
htrutatellesnobrega, elmiko: https://hadoop.apache.org/docs/stable/hadoop-openstack/index.html#General_Swift_Filesystem_configuration_options14:03
htrutalooks like it breaks in 32 MB blocks by default14:03
tellesnobregathanks htruta and elmiko14:05
*** esikachev has quit IRC14:06
tellesnobregaactually htruta the default value is 64KB, swift declares blocks of 32MB but the requests are made (by default) using 64KB, same as HDFS14:08
elmikohtruta, interesting...14:10
*** esikachev has joined #openstack-sahara14:11
*** hdd has joined #openstack-sahara14:14
*** raildo has joined #openstack-sahara14:17
*** openstackgerrit_ has quit IRC14:17
*** openstackgerrit_ has joined #openstack-sahara14:18
*** crobertsrh has left #openstack-sahara14:18
*** crobertsrh has joined #openstack-sahara14:20
*** tellesnobrega has quit IRC14:23
*** tellesnobrega has joined #openstack-sahara14:24
*** tellesnobrega has quit IRC14:25
*** tosky has quit IRC14:25
*** tellesnobrega has joined #openstack-sahara14:26
*** _mattf is now known as mattf14:27
*** sgotliv has quit IRC14:28
*** sgotliv has joined #openstack-sahara14:29
*** tosky has joined #openstack-sahara14:30
*** openstackgerrit_ has quit IRC14:31
*** esikachev has quit IRC14:33
*** hdd has quit IRC14:37
*** vgridnev has joined #openstack-sahara14:40
*** tellesnobrega_ has joined #openstack-sahara14:42
*** tellesnobrega_ has quit IRC14:42
*** tellesnobrega_ has joined #openstack-sahara14:42
*** tellesnobrega_ has quit IRC14:44
*** tellesnobrega_ has joined #openstack-sahara14:45
*** hdd has joined #openstack-sahara14:46
*** tellesnobrega_ has quit IRC14:48
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding HTTP PATCH method to modify existing resources  https://review.openstack.org/21104214:48
*** tellesnobrega_ has joined #openstack-sahara14:51
*** IBerezovskiy has joined #openstack-sahara15:02
*** tellesno` has joined #openstack-sahara15:03
*** tellesnobrega has quit IRC15:08
*** tellesno` has quit IRC15:09
*** tellesnobrega has joined #openstack-sahara15:10
*** tellesnobrega has quit IRC15:13
*** tellesnobrega has joined #openstack-sahara15:13
*** saneax has joined #openstack-sahara15:18
*** esikachev has joined #openstack-sahara15:28
*** vgridnev has quit IRC15:29
*** vgridnev has joined #openstack-sahara15:31
openstackgerritMerged openstack/puppet-sahara: Use openstack/ namespace for fixtures modules  https://review.openstack.org/21155915:42
*** Poornima has quit IRC15:48
*** esikachev has quit IRC15:49
*** ylobankov has quit IRC15:53
*** vgridnev has quit IRC15:56
*** openstackgerrit_ has joined #openstack-sahara16:08
*** tellesnobrega_ has quit IRC16:13
*** ylobankov has joined #openstack-sahara16:20
*** ig0r_ has joined #openstack-sahara16:20
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Add jobs for Ambari 2.1  https://review.openstack.org/21053116:25
*** crobertsrh has left #openstack-sahara16:25
*** crobertsrh has joined #openstack-sahara16:26
*** raildo__ has joined #openstack-sahara16:29
*** esikachev has joined #openstack-sahara16:35
*** raildo__ has quit IRC16:35
*** htruta has quit IRC16:41
*** htruta has joined #openstack-sahara16:43
*** htruta has quit IRC16:44
*** esikachev has quit IRC16:46
*** ig0r_ has quit IRC16:48
*** raildo has quit IRC16:53
*** raildo has joined #openstack-sahara16:55
*** htruta has joined #openstack-sahara16:55
*** tellesnobrega has quit IRC16:56
*** tellesnobrega has joined #openstack-sahara16:56
*** tellesnobrega has quit IRC16:57
*** tellesnobrega has joined #openstack-sahara16:57
*** tellesnobrega has quit IRC16:58
*** tellesnobrega has joined #openstack-sahara16:59
*** melaks has joined #openstack-sahara16:59
*** tellesnobrega has quit IRC17:01
*** tellesnobrega has joined #openstack-sahara17:01
*** esikachev has joined #openstack-sahara17:04
*** raildo has quit IRC17:21
*** raildo has joined #openstack-sahara17:29
*** raildo has quit IRC17:29
*** vgridnev has joined #openstack-sahara17:48
*** sgotliv has quit IRC17:52
*** tosky has quit IRC17:55
*** htruta_ has joined #openstack-sahara18:02
*** esikachev has quit IRC18:05
*** openstackgerrit_ has quit IRC18:06
*** ig0r_ has joined #openstack-sahara18:17
*** ig0r_ has quit IRC18:18
*** vgridnev has quit IRC18:18
*** melaks has quit IRC18:19
*** esikachev has joined #openstack-sahara18:22
*** htruta_ has quit IRC18:24
*** vgridnev has joined #openstack-sahara18:25
*** melaks has joined #openstack-sahara18:25
*** ig0r_ has joined #openstack-sahara18:27
elmikoSergeyLukjanov, this job https://review.openstack.org/#/c/207208/ doesn't seem to be hitting the ci, i tried yesterday and again today but i am not seeing it go through. is there anywhere i can check about this?18:27
*** tmckay has quit IRC18:33
*** tmckay has joined #openstack-sahara18:37
*** hdd has quit IRC18:44
*** esikachev has quit IRC18:49
*** esikachev has joined #openstack-sahara18:56
*** ig0r_ has quit IRC18:59
openstackgerritTrevor McKay proposed openstack/sahara: Add manila nfs data sources  https://review.openstack.org/20961519:00
*** Nikolay_St has quit IRC19:00
*** ig0r_ has joined #openstack-sahara19:03
*** mattf is now known as _mattf19:05
SergeyLukjanovtmckay, hi, do we have spec for https://blueprints.launchpad.net/sahara/+spec/manila-as-binary-store &19:19
elmikoSergeyLukjanov, did you see my ping re: ci ?19:19
SergeyLukjanovdegorenko, could you pleae take a look at19:20
SergeyLukjanov[21:27:44]  <elmiko>SergeyLukjanov, this job https://review.openstack.org/#/c/207208/ doesn't seem to be hitting the ci, i tried yesterday and again today but i am not seeing it go through. is there anywhere i can check about this?19:20
SergeyLukjanovelmiko yup :)19:20
tmckaySergeyLukjanov, yep, It was merged a while ago19:20
tmckayhttps://review.openstack.org/#/c/202249/19:20
elmikoSergeyLukjanov, thanks!19:20
tmckaySergeyLukjanov, what we don't have a spec for yet is data sources19:20
tmckayworking on that.  I need to check the Intel spec, too.  Wanted to see if I could make it work first19:20
SergeyLukjanovtmckay, ack, I've mean https://blueprints.launchpad.net/sahara/+spec/manila-as-a-data-source :)19:21
SergeyLukjanovbut you already answered19:21
tmckayoh, yes.  I need to work on that.  Trying to find an nfs issue atm19:22
*** hdd has joined #openstack-sahara19:22
*** melaks has quit IRC19:31
openstackgerritMerged openstack/python-saharaclient: Updated from global requirements  https://review.openstack.org/21163119:40
*** ig0r_ has quit IRC19:58
*** ig0r_ has joined #openstack-sahara20:07
*** esikachev has quit IRC20:13
*** melaks has joined #openstack-sahara20:36
*** ig0r_ has quit IRC20:58
SergeyLukjanovfolks, we have the saharaclient release, yay!21:02
SergeyLukjanov0.10.0 version21:02
SergeyLukjanov:)21:02
elmikowoot!21:02
elmikoand you are up late SergeyLukjanov !21:02
SergeyLukjanov:)21:03
SergeyLukjanovI've spent some additional time for the new release process21:03
SergeyLukjanovfor managed projects21:03
SergeyLukjanovit's currently released by the CR to openstack/releases21:03
SergeyLukjanovand after that the release manager reviews it and runs scripts to perform release21:04
elmikooh nice, i think i saw that for another project. looked convenient21:04
SergeyLukjanovand I've tried to run this scripts by myself to be able to help with other projects21:04
SergeyLukjanovelmiko, I'm in library release team, so, ping me if you'll need release for some lib :)21:05
*** crobertsrh is now known as _crobertsrh21:05
elmikoooh, will do =)21:05
elmikoalthough, the lib i'm most concerned with currently is not part of that team, castellan21:06
*** saneax has quit IRC21:07
*** melaks has quit IRC21:10
*** melaks has joined #openstack-sahara21:15
*** hdd has quit IRC21:39
*** hdd has joined #openstack-sahara21:40
*** vgridnev has quit IRC21:54
*** vgridnev has joined #openstack-sahara21:54
*** vgridnev has quit IRC21:54
*** egafford has quit IRC21:56
*** melaks has quit IRC22:21
*** saneax has joined #openstack-sahara22:53
*** esikachev has joined #openstack-sahara23:20
*** elmiko has quit IRC23:23
*** egafford has joined #openstack-sahara23:31
*** esikachev has quit IRC23:35

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!