*** elmiko_ has joined #openstack-sahara | 01:03 | |
*** elmiko has quit IRC | 01:06 | |
*** melaks has quit IRC | 01:10 | |
*** elmiko_ has quit IRC | 01:11 | |
*** elmiko has joined #openstack-sahara | 01:20 | |
*** coolsvap_ has joined #openstack-sahara | 01:24 | |
*** coolsvap_ has quit IRC | 01:36 | |
*** elmiko_ has joined #openstack-sahara | 01:48 | |
*** elmiko_ has quit IRC | 01:51 | |
*** elmiko has quit IRC | 01:52 | |
*** hdd has quit IRC | 03:39 | |
*** logan2 has quit IRC | 03:47 | |
*** logan2 has joined #openstack-sahara | 03:55 | |
*** hdd has joined #openstack-sahara | 04:11 | |
*** hdd has quit IRC | 04:17 | |
*** hdd has joined #openstack-sahara | 04:19 | |
*** hdd has quit IRC | 04:24 | |
*** hdd has joined #openstack-sahara | 04:24 | |
*** hdd has quit IRC | 04:31 | |
*** hdd has joined #openstack-sahara | 04:31 | |
*** Poornima has joined #openstack-sahara | 04:45 | |
*** hdd has quit IRC | 04:49 | |
*** david-lyle has joined #openstack-sahara | 04:50 | |
*** hdd has joined #openstack-sahara | 04:58 | |
*** Nikolay_St has quit IRC | 05:38 | |
*** melaks has joined #openstack-sahara | 05:38 | |
*** melaks has quit IRC | 05:50 | |
*** hdd has quit IRC | 05:52 | |
*** vgridnev has joined #openstack-sahara | 05:54 | |
*** melaks has joined #openstack-sahara | 05:55 | |
*** vgridnev has quit IRC | 06:00 | |
*** vgridnev has joined #openstack-sahara | 06:09 | |
*** melaks has quit IRC | 06:10 | |
*** melaks has joined #openstack-sahara | 06:18 | |
*** melaks has quit IRC | 06:29 | |
*** vgridnev has quit IRC | 06:52 | |
*** esikachev has joined #openstack-sahara | 07:11 | |
*** vgridnev has joined #openstack-sahara | 07:56 | |
*** esikachev has quit IRC | 08:12 | |
*** links has joined #openstack-sahara | 08:13 | |
*** esikachev has joined #openstack-sahara | 08:20 | |
*** sgotliv has joined #openstack-sahara | 08:27 | |
*** sgotliv has quit IRC | 08:27 | |
*** sgotliv has joined #openstack-sahara | 08:28 | |
*** melaks has joined #openstack-sahara | 08:29 | |
*** esikachev has quit IRC | 08:56 | |
openstackgerrit | Andrey Pavlov proposed openstack/sahara-specs: Addding spec for Objects update support in Sahara API https://review.openstack.org/208378 | 08:57 |
---|---|---|
*** melaks has quit IRC | 09:02 | |
*** esikachev has joined #openstack-sahara | 09:09 | |
*** tosky has joined #openstack-sahara | 09:17 | |
*** Nikolay_St has joined #openstack-sahara | 09:18 | |
openstackgerrit | Andrey Pavlov proposed openstack/sahara-specs: Addding spec for Objects update support in Sahara API https://review.openstack.org/208378 | 09:24 |
*** esikachev has quit IRC | 09:47 | |
*** vgridnev has quit IRC | 09:56 | |
*** ylobankov__ has joined #openstack-sahara | 09:56 | |
*** ylobankov_ has quit IRC | 09:56 | |
*** vgridnev has joined #openstack-sahara | 09:57 | |
openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding job_execution_update api call https://review.openstack.org/197914 | 10:04 |
openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding job_execution_update api call https://review.openstack.org/197914 | 10:07 |
openstackgerrit | lu huichun proposed openstack/sahara: [EDP] Add suspend_job() for sahara edp engine(oozie implementation) https://review.openstack.org/201448 | 10:15 |
openstackgerrit | Andrey Pavlov proposed openstack/sahara: Formatting and mounting methods changed for ironic https://review.openstack.org/200483 | 10:23 |
*** esikachev has joined #openstack-sahara | 10:23 | |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: [WIP] New version of HDP plugin https://review.openstack.org/184292 | 10:53 |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New version of HDP plugin https://review.openstack.org/184292 | 10:54 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Add API methods for call verifications, DB table https://review.openstack.org/196713 | 11:04 |
openstackgerrit | lu huichun proposed openstack/python-saharaclient: Add job execution update https://review.openstack.org/208001 | 11:21 |
*** saneax has joined #openstack-sahara | 11:23 | |
*** coolsvap has quit IRC | 11:50 | |
*** coolsvap has joined #openstack-sahara | 11:51 | |
*** openstackgerrit_ has joined #openstack-sahara | 12:02 | |
*** saneax has quit IRC | 12:17 | |
*** saneax has joined #openstack-sahara | 12:18 | |
*** saneax has quit IRC | 12:30 | |
*** egafford has joined #openstack-sahara | 12:32 | |
*** ylobankov__ is now known as ylobankov | 12:34 | |
*** saneax has joined #openstack-sahara | 12:34 | |
*** links has quit IRC | 12:48 | |
*** _crobertsrh is now known as crobertsrh | 12:50 | |
*** openstackgerrit_ has quit IRC | 12:51 | |
*** openstackgerrit_ has joined #openstack-sahara | 12:56 | |
openstackgerrit | Yanis Guenane proposed openstack/puppet-sahara: Use openstack/ namespace for fixtures modules https://review.openstack.org/211559 | 12:56 |
*** elmiko has joined #openstack-sahara | 13:05 | |
elmiko | is sahara ci hosed? | 13:06 |
pino|work | "morning people, how are you? is the sahara ci facing issues currently?" | 13:10 |
*** tmckay has left #openstack-sahara | 13:10 | |
elmiko | pino|work, pretty much. i have a patch that's been waiting 11 hours for ci ಠ_ಠ | 13:12 |
*** tmckay has joined #openstack-sahara | 13:13 | |
tellesnobrega | hey guys, anyone care to take a look at https://review.openstack.org/#/c/203067/ ? | 13:29 |
*** vgridnev has quit IRC | 13:33 | |
*** vgridnev has joined #openstack-sahara | 13:34 | |
*** vgridnev has quit IRC | 13:34 | |
*** david-lyle has quit IRC | 13:36 | |
*** crobertsrh has left #openstack-sahara | 13:40 | |
tellesnobrega | i'm not sure if there are any new people here wanting to use sahara but htruta wrote a realy nice tutorial on how to submit hadoop jobs using sahara python client http://henriquetruta.com/mapreduce-job-sahara-python/ | 13:41 |
htruta | tellesnobrega: o/ | 13:42 |
*** crobertsrh has joined #openstack-sahara | 13:43 | |
tellesnobrega | elmiko: when using hadoop + swift in sahara, when a job starts hadoop brings pieces of data from swift just like hdfs? | 13:46 |
openstackgerrit | Trevor McKay proposed openstack/sahara: Add manila nfs data sources https://review.openstack.org/209615 | 13:47 |
openstackgerrit | Trevor McKay proposed openstack/sahara: Support manila shares as binary store https://review.openstack.org/204690 | 13:47 |
openstackgerrit | Trevor McKay proposed openstack/sahara: Allow Sahara native urls and runtime urls to differ for datasources https://review.openstack.org/209634 | 13:47 |
tmckay | sigh | 13:47 |
tellesnobrega | tmckay: you probably know that ^ | 13:49 |
elmiko | tellesnobrega, well, it grabs whatever object you specify | 13:49 |
elmiko | or writes to it | 13:49 |
tmckay | tellesnobrega, yes, I believe so. It serializes objects from swift | 13:49 |
tmckay | but I don't know a lot of detail about it | 13:50 |
tmckay | I know I had issues with swift/spark because one of the serialization classes broke, and we needed a different JAR | 13:50 |
*** openstackgerrit_ has quit IRC | 13:55 | |
tellesnobrega | elmiko: ok, so my questions is more on the direction of, does it bring the whole file at once or fetchs in small pieces? | 13:55 |
*** openstackgerrit_ has joined #openstack-sahara | 13:56 | |
elmiko | tellesnobrega, well, on the swift end, a GET request is made and then the file is sent back | 13:56 |
elmiko | i'm not sure exactly what is being done inside the hadoop-swift jar, but at the lowest level that is how it will work | 13:56 |
elmiko | it should be the whole file, although it might take time to download and i'm not sure how the jar decides to buffer that. | 13:57 |
*** vgridnev has joined #openstack-sahara | 13:57 | |
openstackgerrit | lu huichun proposed openstack/python-saharaclient: Add job execution update https://review.openstack.org/208001 | 13:57 |
*** vgridnev has quit IRC | 13:58 | |
*** saneax has quit IRC | 14:00 | |
htruta | tellesnobrega, elmiko: https://hadoop.apache.org/docs/stable/hadoop-openstack/index.html#General_Swift_Filesystem_configuration_options | 14:03 |
htruta | looks like it breaks in 32 MB blocks by default | 14:03 |
tellesnobrega | thanks htruta and elmiko | 14:05 |
*** esikachev has quit IRC | 14:06 | |
tellesnobrega | actually htruta the default value is 64KB, swift declares blocks of 32MB but the requests are made (by default) using 64KB, same as HDFS | 14:08 |
elmiko | htruta, interesting... | 14:10 |
*** esikachev has joined #openstack-sahara | 14:11 | |
*** hdd has joined #openstack-sahara | 14:14 | |
*** raildo has joined #openstack-sahara | 14:17 | |
*** openstackgerrit_ has quit IRC | 14:17 | |
*** openstackgerrit_ has joined #openstack-sahara | 14:18 | |
*** crobertsrh has left #openstack-sahara | 14:18 | |
*** crobertsrh has joined #openstack-sahara | 14:20 | |
*** tellesnobrega has quit IRC | 14:23 | |
*** tellesnobrega has joined #openstack-sahara | 14:24 | |
*** tellesnobrega has quit IRC | 14:25 | |
*** tosky has quit IRC | 14:25 | |
*** tellesnobrega has joined #openstack-sahara | 14:26 | |
*** _mattf is now known as mattf | 14:27 | |
*** sgotliv has quit IRC | 14:28 | |
*** sgotliv has joined #openstack-sahara | 14:29 | |
*** tosky has joined #openstack-sahara | 14:30 | |
*** openstackgerrit_ has quit IRC | 14:31 | |
*** esikachev has quit IRC | 14:33 | |
*** hdd has quit IRC | 14:37 | |
*** vgridnev has joined #openstack-sahara | 14:40 | |
*** tellesnobrega_ has joined #openstack-sahara | 14:42 | |
*** tellesnobrega_ has quit IRC | 14:42 | |
*** tellesnobrega_ has joined #openstack-sahara | 14:42 | |
*** tellesnobrega_ has quit IRC | 14:44 | |
*** tellesnobrega_ has joined #openstack-sahara | 14:45 | |
*** hdd has joined #openstack-sahara | 14:46 | |
*** tellesnobrega_ has quit IRC | 14:48 | |
openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding HTTP PATCH method to modify existing resources https://review.openstack.org/211042 | 14:48 |
*** tellesnobrega_ has joined #openstack-sahara | 14:51 | |
*** IBerezovskiy has joined #openstack-sahara | 15:02 | |
*** tellesno` has joined #openstack-sahara | 15:03 | |
*** tellesnobrega has quit IRC | 15:08 | |
*** tellesno` has quit IRC | 15:09 | |
*** tellesnobrega has joined #openstack-sahara | 15:10 | |
*** tellesnobrega has quit IRC | 15:13 | |
*** tellesnobrega has joined #openstack-sahara | 15:13 | |
*** saneax has joined #openstack-sahara | 15:18 | |
*** esikachev has joined #openstack-sahara | 15:28 | |
*** vgridnev has quit IRC | 15:29 | |
*** vgridnev has joined #openstack-sahara | 15:31 | |
openstackgerrit | Merged openstack/puppet-sahara: Use openstack/ namespace for fixtures modules https://review.openstack.org/211559 | 15:42 |
*** Poornima has quit IRC | 15:48 | |
*** esikachev has quit IRC | 15:49 | |
*** ylobankov has quit IRC | 15:53 | |
*** vgridnev has quit IRC | 15:56 | |
*** openstackgerrit_ has joined #openstack-sahara | 16:08 | |
*** tellesnobrega_ has quit IRC | 16:13 | |
*** ylobankov has joined #openstack-sahara | 16:20 | |
*** ig0r_ has joined #openstack-sahara | 16:20 | |
openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Add jobs for Ambari 2.1 https://review.openstack.org/210531 | 16:25 |
*** crobertsrh has left #openstack-sahara | 16:25 | |
*** crobertsrh has joined #openstack-sahara | 16:26 | |
*** raildo__ has joined #openstack-sahara | 16:29 | |
*** esikachev has joined #openstack-sahara | 16:35 | |
*** raildo__ has quit IRC | 16:35 | |
*** htruta has quit IRC | 16:41 | |
*** htruta has joined #openstack-sahara | 16:43 | |
*** htruta has quit IRC | 16:44 | |
*** esikachev has quit IRC | 16:46 | |
*** ig0r_ has quit IRC | 16:48 | |
*** raildo has quit IRC | 16:53 | |
*** raildo has joined #openstack-sahara | 16:55 | |
*** htruta has joined #openstack-sahara | 16:55 | |
*** tellesnobrega has quit IRC | 16:56 | |
*** tellesnobrega has joined #openstack-sahara | 16:56 | |
*** tellesnobrega has quit IRC | 16:57 | |
*** tellesnobrega has joined #openstack-sahara | 16:57 | |
*** tellesnobrega has quit IRC | 16:58 | |
*** tellesnobrega has joined #openstack-sahara | 16:59 | |
*** melaks has joined #openstack-sahara | 16:59 | |
*** tellesnobrega has quit IRC | 17:01 | |
*** tellesnobrega has joined #openstack-sahara | 17:01 | |
*** esikachev has joined #openstack-sahara | 17:04 | |
*** raildo has quit IRC | 17:21 | |
*** raildo has joined #openstack-sahara | 17:29 | |
*** raildo has quit IRC | 17:29 | |
*** vgridnev has joined #openstack-sahara | 17:48 | |
*** sgotliv has quit IRC | 17:52 | |
*** tosky has quit IRC | 17:55 | |
*** htruta_ has joined #openstack-sahara | 18:02 | |
*** esikachev has quit IRC | 18:05 | |
*** openstackgerrit_ has quit IRC | 18:06 | |
*** ig0r_ has joined #openstack-sahara | 18:17 | |
*** ig0r_ has quit IRC | 18:18 | |
*** vgridnev has quit IRC | 18:18 | |
*** melaks has quit IRC | 18:19 | |
*** esikachev has joined #openstack-sahara | 18:22 | |
*** htruta_ has quit IRC | 18:24 | |
*** vgridnev has joined #openstack-sahara | 18:25 | |
*** melaks has joined #openstack-sahara | 18:25 | |
*** ig0r_ has joined #openstack-sahara | 18:27 | |
elmiko | SergeyLukjanov, this job https://review.openstack.org/#/c/207208/ doesn't seem to be hitting the ci, i tried yesterday and again today but i am not seeing it go through. is there anywhere i can check about this? | 18:27 |
*** tmckay has quit IRC | 18:33 | |
*** tmckay has joined #openstack-sahara | 18:37 | |
*** hdd has quit IRC | 18:44 | |
*** esikachev has quit IRC | 18:49 | |
*** esikachev has joined #openstack-sahara | 18:56 | |
*** ig0r_ has quit IRC | 18:59 | |
openstackgerrit | Trevor McKay proposed openstack/sahara: Add manila nfs data sources https://review.openstack.org/209615 | 19:00 |
*** Nikolay_St has quit IRC | 19:00 | |
*** ig0r_ has joined #openstack-sahara | 19:03 | |
*** mattf is now known as _mattf | 19:05 | |
SergeyLukjanov | tmckay, hi, do we have spec for https://blueprints.launchpad.net/sahara/+spec/manila-as-binary-store & | 19:19 |
elmiko | SergeyLukjanov, did you see my ping re: ci ? | 19:19 |
SergeyLukjanov | degorenko, could you pleae take a look at | 19:20 |
SergeyLukjanov | [21:27:44] <elmiko>SergeyLukjanov, this job https://review.openstack.org/#/c/207208/ doesn't seem to be hitting the ci, i tried yesterday and again today but i am not seeing it go through. is there anywhere i can check about this? | 19:20 |
SergeyLukjanov | elmiko yup :) | 19:20 |
tmckay | SergeyLukjanov, yep, It was merged a while ago | 19:20 |
tmckay | https://review.openstack.org/#/c/202249/ | 19:20 |
elmiko | SergeyLukjanov, thanks! | 19:20 |
tmckay | SergeyLukjanov, what we don't have a spec for yet is data sources | 19:20 |
tmckay | working on that. I need to check the Intel spec, too. Wanted to see if I could make it work first | 19:20 |
SergeyLukjanov | tmckay, ack, I've mean https://blueprints.launchpad.net/sahara/+spec/manila-as-a-data-source :) | 19:21 |
SergeyLukjanov | but you already answered | 19:21 |
tmckay | oh, yes. I need to work on that. Trying to find an nfs issue atm | 19:22 |
*** hdd has joined #openstack-sahara | 19:22 | |
*** melaks has quit IRC | 19:31 | |
openstackgerrit | Merged openstack/python-saharaclient: Updated from global requirements https://review.openstack.org/211631 | 19:40 |
*** ig0r_ has quit IRC | 19:58 | |
*** ig0r_ has joined #openstack-sahara | 20:07 | |
*** esikachev has quit IRC | 20:13 | |
*** melaks has joined #openstack-sahara | 20:36 | |
*** ig0r_ has quit IRC | 20:58 | |
SergeyLukjanov | folks, we have the saharaclient release, yay! | 21:02 |
SergeyLukjanov | 0.10.0 version | 21:02 |
SergeyLukjanov | :) | 21:02 |
elmiko | woot! | 21:02 |
elmiko | and you are up late SergeyLukjanov ! | 21:02 |
SergeyLukjanov | :) | 21:03 |
SergeyLukjanov | I've spent some additional time for the new release process | 21:03 |
SergeyLukjanov | for managed projects | 21:03 |
SergeyLukjanov | it's currently released by the CR to openstack/releases | 21:03 |
SergeyLukjanov | and after that the release manager reviews it and runs scripts to perform release | 21:04 |
elmiko | oh nice, i think i saw that for another project. looked convenient | 21:04 |
SergeyLukjanov | and I've tried to run this scripts by myself to be able to help with other projects | 21:04 |
SergeyLukjanov | elmiko, I'm in library release team, so, ping me if you'll need release for some lib :) | 21:05 |
*** crobertsrh is now known as _crobertsrh | 21:05 | |
elmiko | ooh, will do =) | 21:05 |
elmiko | although, the lib i'm most concerned with currently is not part of that team, castellan | 21:06 |
*** saneax has quit IRC | 21:07 | |
*** melaks has quit IRC | 21:10 | |
*** melaks has joined #openstack-sahara | 21:15 | |
*** hdd has quit IRC | 21:39 | |
*** hdd has joined #openstack-sahara | 21:40 | |
*** vgridnev has quit IRC | 21:54 | |
*** vgridnev has joined #openstack-sahara | 21:54 | |
*** vgridnev has quit IRC | 21:54 | |
*** egafford has quit IRC | 21:56 | |
*** melaks has quit IRC | 22:21 | |
*** saneax has joined #openstack-sahara | 22:53 | |
*** esikachev has joined #openstack-sahara | 23:20 | |
*** elmiko has quit IRC | 23:23 | |
*** egafford has joined #openstack-sahara | 23:31 | |
*** esikachev has quit IRC | 23:35 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!