*** SergeyLukjanov has joined #savanna | 00:18 | |
*** matsuhashi has joined #savanna | 00:20 | |
*** akuznetsov has quit IRC | 00:24 | |
*** SergeyLukjanov has quit IRC | 00:41 | |
*** sacharya has joined #savanna | 00:57 | |
*** akuznetsov has joined #savanna | 01:06 | |
*** nosnos has joined #savanna | 01:11 | |
*** tmckay has joined #savanna | 01:41 | |
*** matsuhashi has quit IRC | 01:46 | |
*** matsuhashi has joined #savanna | 01:47 | |
*** akuznetsov has quit IRC | 01:48 | |
*** matsuhas_ has joined #savanna | 01:49 | |
*** matsuhashi has quit IRC | 01:49 | |
*** tmckay has quit IRC | 03:08 | |
*** _mattf has quit IRC | 04:40 | |
*** akuznetsov has joined #savanna | 04:44 | |
*** _mattf has joined #savanna | 04:47 | |
*** sacharya has quit IRC | 05:05 | |
*** dguitarbite has joined #savanna | 05:38 | |
*** akuznetsov has quit IRC | 07:25 | |
*** DinaBelova has joined #savanna | 07:32 | |
*** dafter has joined #savanna | 07:50 | |
*** tvb|afk has joined #savanna | 07:51 | |
*** dafter has quit IRC | 07:55 | |
*** akuznetsov has joined #savanna | 08:13 | |
*** dmitryme has joined #savanna | 08:14 | |
*** nprivalova has joined #savanna | 08:27 | |
*** akuznetsov has quit IRC | 09:06 | |
*** tvb|afk has quit IRC | 09:18 | |
*** matsuhas_ has quit IRC | 09:19 | |
*** matsuhas_ has joined #savanna | 09:19 | |
*** akuznetsov has joined #savanna | 09:31 | |
*** dafter has joined #savanna | 09:36 | |
*** dafter has joined #savanna | 09:36 | |
*** akuznetsov has quit IRC | 09:42 | |
*** nprivalova has quit IRC | 09:45 | |
*** nprivalova has joined #savanna | 09:50 | |
*** DinaBelova has quit IRC | 10:14 | |
*** nprivalova has quit IRC | 10:17 | |
*** akuznetsov has joined #savanna | 10:21 | |
*** nprivalova has joined #savanna | 10:50 | |
*** DinaBelova has joined #savanna | 10:52 | |
openstackgerrit | Dmitry Mescheryakov proposed a change to openstack/savanna: Minor docs restructurization https://review.openstack.org/52061 | 11:00 |
---|---|---|
*** dmitryme has quit IRC | 11:01 | |
*** DinaBelova has quit IRC | 11:43 | |
*** _crobertsrh is now known as crobertsrh | 12:00 | |
*** nprivalova has quit IRC | 12:12 | |
*** nprivalova has joined #savanna | 12:35 | |
*** bogdando has quit IRC | 12:37 | |
*** bogdando has joined #savanna | 12:40 | |
*** nosnos has quit IRC | 12:55 | |
*** nosnos has joined #savanna | 12:55 | |
*** nosnos has quit IRC | 13:00 | |
*** nprivalova is now known as nadya | 13:25 | |
*** akuznetsov has quit IRC | 13:28 | |
aignatov | crobertsrh, I think it's bug and a feature at the same time when user can give a new name for job-binary, but there is a bug if that new name is wrong and doesn't contain .jar at end. | 13:32 |
crobertsrh | aignatov: Right. Perhaps just some extra documentation (especially within the UI) is the way to go. | 13:32 |
crobertsrh | Or maybe some extra validation to be sure that an uploaded ".jar" file maintains a ".jar" when the user names it. | 13:34 |
aignatov | Also I think that we should implement a feature in the UI - to put the name of uploaded binary file to the name field in the UI | 13:35 |
aignatov | if user wants he can change it of course | 13:36 |
*** rnirmal has joined #savanna | 13:37 | |
crobertsrh | That is probably a good idea | 13:44 |
*** _mattf is now known as mattf | 13:55 | |
*** mattf has quit IRC | 13:55 | |
*** mattf has joined #savanna | 13:55 | |
*** akuznetsov has joined #savanna | 13:56 | |
*** SergeyLukjanov has joined #savanna | 14:07 | |
*** tmckay has joined #savanna | 14:13 | |
*** sacharya has joined #savanna | 14:23 | |
*** dmitryme has joined #savanna | 14:29 | |
aignatov | tmckay, will you plan to continue work on https://review.openstack.org/#/c/51017/ ? | 14:36 |
aignatov | рш | 14:36 |
aignatov | hi | 14:36 |
tmckay | aignatov, yes. I thought, along with crobertsrh, I would try to run your demo job end to end through savanna. So far, we both are getting some kind of classpath error with PigMain | 14:37 |
tmckay | aignatov, but I can work on the doc instead and come back to it | 14:37 |
aignatov | actually we have to fininsh docs before the release 0.3 | 14:38 |
aignatov | release is tomorrow sfaik | 14:38 |
*** matsuhas_ has quit IRC | 14:38 | |
aignatov | *afaik | 14:38 |
*** matsuhashi has joined #savanna | 14:39 | |
*** matsuhashi has joined #savanna | 14:40 | |
tmckay | aignatov, well, then I suppose I have to finish it today :) Okay, otp now on a conference call but then I will do nothing but the edp section | 14:41 |
*** matsuhashi has quit IRC | 14:42 | |
*** matsuhashi has joined #savanna | 14:42 | |
aignatov | btw, when I finish my doc section with rest api I will able to help you to debug edp | 14:44 |
*** SergeyLukjanov is now known as _SergeyLukjanov | 14:46 | |
crobertsrh | No prob. I have my job running on ubuntu....trying fedora image now. | 14:47 |
*** matsuhashi has quit IRC | 14:47 | |
*** _SergeyLukjanov is now known as SergeyLukjanov | 14:50 | |
*** sacharya has quit IRC | 14:51 | |
tmckay | aignatov, my plan for the EDP page at this point is to add simple definitions of all the object types and then a simple bullet point workflow. Essentially text that more or less corresponds to your demo | 15:02 |
tmckay | nothing to complicated. Also, maybe a link to the REST api section | 15:02 |
*** SergeyLukjanov is now known as _SergeyLukjanov | 15:03 | |
tmckay | so, "this is a job_binary", "this is a job", "this is a datasource", "this is an execution" etc | 15:03 |
*** _SergeyLukjanov has quit IRC | 15:03 | |
*** SergeyLukjanov has joined #savanna | 15:04 | |
*** dmitryme has quit IRC | 15:04 | |
tmckay | aignatov, I'll probably mention too that every job in savanna is wrapped in Oozie currently | 15:05 |
aignatov | tmckay, that's a good plan | 15:06 |
tmckay | if we need to expand in 0.3.next, we can add more detail based on user feedback | 15:06 |
aignatov | SergeyLukjanov, here? | 15:07 |
SergeyLukjanov | aignatov, partially :) | 15:13 |
aignatov | ok, please read our above conversation, and will your ok with that plan? | 15:13 |
*** rnirmal has quit IRC | 15:13 | |
aignatov | above means from 18:35 | 15:13 |
SergeyLukjanov | sounds ok | 15:16 |
SergeyLukjanov | will it be ready till the tomorrows evening? | 15:17 |
aignatov | rest api yes | 15:17 |
openstackgerrit | A change was merged to openstack/savanna: Integration test improvements https://review.openstack.org/51625 | 15:17 |
tmckay | SergeyLukjanov, I should be ready too. Nothing else today until EDP doc is done :) | 15:17 |
aignatov | dmitryme also will add some part about transient clusters and needed configs for trusts as well | 15:18 |
aignatov | also I think we should remove edp spi section | 15:18 |
aignatov | tmkcay what so you think about removing edp spi page? | 15:19 |
aignatov | so -> do | 15:19 |
*** SergeyLukjanov has quit IRC | 15:20 | |
tmckay | aignatov, I could agree with that. I'm not familiar enough to know what goes on the spi page | 15:20 |
tmckay | If someone knows what to write, we could add it. Or, we could put in a knowledge base or a wiki later. | 15:21 |
tmckay | aignatov, I know we mentioned one thing the other day that should go there. Maybe it's there, but really short. | 15:22 |
*** sacharya has joined #savanna | 15:26 | |
aignatov | tmckay, yes I remember something, actually spi meant which methods plugins should have to support edp | 15:28 |
aignatov | something like that | 15:28 |
tmckay | yes | 15:28 |
aignatov | but it seems nothing now | 15:28 |
aignatov | only hive get_hive_config_path, but hive is not working with edp now | 15:29 |
aignatov | so botheng should go there | 15:29 |
tmckay | aignatov, here is your comment from 10_8 | 15:33 |
tmckay | 11:57:30 AM) aignatov: tmckay, at least we must have info about how EDP works with oozie in code, for examle developers shoudl know that plugin must set 'Info''oozie'[url] in set_cluster_info | 15:33 |
tmckay | (11:57:35 AM) aignatov: something like that | 15:33 |
tmckay | that's all I remember that was mentioned specifically | 15:33 |
aignatov | indeed, yes, I just talked with dmitryme, I asked him to add this point to somewhere in docs :) | 15:35 |
aignatov | but you could add the same to spi page, eventually it will have some content :-) | 15:36 |
aignatov | really, plugin must do this to support edp so we should mention it somewhere | 15:38 |
tmckay | That could be the only content on the spi page for now. I think that would be okay. I don't know enough to write it, though -- someone else must write the text and I can review :) | 15:38 |
aignatov | +1 | 15:52 |
*** SergeyLukjanov has joined #savanna | 15:53 | |
*** nadya has quit IRC | 15:56 | |
tmckay | aignatov, will there be docs for the python-savannaclient, too? It might be nice to link to that. | 16:11 |
tmckay | aignatov, also, if you can add this to the top of the REST API 1.1 page I can link to it (just like the stuff Chad did) | 16:15 |
tmckay | diff --git a/doc/source/userdoc/rest_api_v1.1_EDP.rst b/doc/source/userdoc/rest_api_v1.1_EDP.rst | 16:15 |
tmckay | index 1beeab2..f7591dc 100644 | 16:15 |
tmckay | --- a/doc/source/userdoc/rest_api_v1.1_EDP.rst | 16:15 |
tmckay | +++ b/doc/source/userdoc/rest_api_v1.1_EDP.rst | 16:15 |
tmckay | @@ -1,3 +1,5 @@ | 16:15 |
tmckay | +.. _rest_api_v1.1_EDP: | 16:15 |
tmckay | + | 16:15 |
tmckay | Savanna REST API v1.1 (EDP) | 16:15 |
tmckay | ============================= | 16:15 |
*** dafter has quit IRC | 16:16 | |
*** rnirmal has joined #savanna | 16:38 | |
tmckay | aignatov, crobertsrh, I just noticed on the demo that on the Create Job Binary page the help text on the right says "Select the type of your Data Source". Should be Job Binary. | 16:43 |
tmckay | not sure if the demo reflects current checkin... | 16:43 |
*** mattf is now known as _mattf | 16:51 | |
crobertsrh | tmckay: I think I recall seeing that at one point too. I'm tweaking help text today, I can change that if it's still there. | 16:52 |
*** _mattf is now known as mattf | 16:52 | |
tmckay | ack thanks | 16:52 |
*** dmitryme has joined #savanna | 17:04 | |
openstackgerrit | Chad Roberts proposed a change to openstack/savanna-dashboard: Adding help text to clarify the name field for job binaries https://review.openstack.org/52162 | 17:04 |
*** dmitryme has quit IRC | 17:19 | |
*** DennyZhang has joined #savanna | 17:20 | |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/savanna: Use python-savannaclient 0.3.rc4 https://review.openstack.org/52170 | 17:30 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/savanna-dashboard: Use python-savannaclient 0.3.rc4 https://review.openstack.org/52171 | 17:31 |
*** dmitryme has joined #savanna | 17:32 | |
*** akuznetsov has quit IRC | 17:34 | |
*** akuznetsov has joined #savanna | 17:35 | |
*** DennyZhang has quit IRC | 17:45 | |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/savanna: Use python-savannaclient 0.3.rc4 https://review.openstack.org/52170 | 17:58 |
*** nadya has joined #savanna | 17:58 | |
openstackgerrit | A change was merged to openstack/savanna-dashboard: Use python-savannaclient 0.3.rc4 https://review.openstack.org/52171 | 17:59 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/savanna: Use python-savannaclient 0.3.rc4 https://review.openstack.org/52170 | 18:03 |
*** akuznetsov has quit IRC | 18:04 | |
*** akuznetsov has joined #savanna | 18:08 | |
*** akuznetsov has quit IRC | 18:12 | |
*** sacharya has quit IRC | 18:18 | |
*** sacharya1 has joined #savanna | 18:18 | |
openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add content to userdoc/edp.rst https://review.openstack.org/51017 | 18:38 |
tmckay | aignatov, SergeyLukjanov, crobertsrh, nadya okay here is my EDP doc content ^^ I have to proofread myself first but I wanted to post it ASAP :) | 18:39 |
tmckay | the links to other docs should work when it's all merged together (and REST has the label). There is actually another way to refer to docs in Sphinx, I may try that -- in that case specific labels may not be needed. | 18:41 |
dmitryme | Great job tmckay! By the way I've recently discovered that OpenStack infrastructure deploys docs from the patch set as drafts | 18:44 |
dmitryme | http://docs-draft.openstack.org/17/51017/3/check/gate-savanna-docs/f4dfec5/doc/build/html/ | 18:44 |
SergeyLukjanov | http://docs-draft.openstack.org/17/51017/3/check/gate-savanna-docs/f4dfec5/doc/build/html/userdoc/edp.html | 18:44 |
SergeyLukjanov | :) | 18:44 |
SergeyLukjanov | tmckay, thank you | 18:44 |
dmitryme | in case you guys didn't know about it | 18:44 |
SergeyLukjanov | btw jenkins posts link to the docs in comments | 18:44 |
tmckay | dmitryme, thanks, I didn't know that. I'll check it out. | 18:45 |
dmitryme | the link name is 'gate-savanna-docs' | 18:45 |
dmitryme | (as addition to what Sergey said) | 18:45 |
tmckay | hopefully I have not told lies about EDP :) | 18:48 |
tmckay | brb | 18:49 |
nadya | tmckay, lloks ok :) not sure about Hive... | 19:02 |
tmckay | does it not run? | 19:02 |
tmckay | I got very close to a Pig run yesterday, but my devstack seems to be broken now, swift says it's full when I try to upload an image via glance. Going to try again. | 19:03 |
openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add content to userdoc/edp.rst https://review.openstack.org/51017 | 19:16 |
tmckay | changed :ref: to :doc: and deleted the second link to the specific edp section so we don't need special labels. | 19:18 |
openstackgerrit | A change was merged to openstack/savanna: Use python-savannaclient 0.3.rc4 https://review.openstack.org/52170 | 19:21 |
openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Remove the section label markups for EDP https://review.openstack.org/52190 | 19:26 |
*** nadya has quit IRC | 19:41 | |
openstackgerrit | Dmitry Mescheryakov proposed a change to openstack/savanna: Added Technical Considerations page for EDP https://review.openstack.org/52198 | 19:49 |
*** SergeyLukjanov is now known as _SergeyLukjanov | 20:06 | |
*** _SergeyLukjanov has quit IRC | 20:06 | |
*** SergeyLukjanov has joined #savanna | 20:08 | |
*** aignatov has quit IRC | 20:11 | |
*** aignatov has joined #savanna | 20:11 | |
*** dmitryme has quit IRC | 20:21 | |
openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add content to userdoc/edp.rst https://review.openstack.org/51017 | 20:21 |
*** dmitryme has joined #savanna | 20:24 | |
openstackgerrit | A change was merged to openstack/savanna: Minor docs restructurization https://review.openstack.org/52061 | 20:41 |
openstackgerrit | A change was merged to openstack/savanna: Remove the section label markups for EDP https://review.openstack.org/52190 | 20:44 |
*** dmitryme has quit IRC | 20:45 | |
*** crobertsrh is now known as _crobertsrh | 21:05 | |
*** tmckay has quit IRC | 21:14 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 21:35 | |
*** _SergeyLukjanov has quit IRC | 21:36 | |
*** SergeyLukjanov has joined #savanna | 21:36 | |
*** mattf is now known as _mattf | 21:42 | |
*** sacharya1 has quit IRC | 21:55 | |
*** _mattf is now known as mattf | 22:03 | |
*** rnirmal has quit IRC | 22:16 | |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/python-savannaclient: Add lower bound for the six dep https://review.openstack.org/52233 | 22:26 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/savanna: Add lower bound for the six dep https://review.openstack.org/52234 | 22:26 |
openstackgerrit | A change was merged to openstack/python-savannaclient: Add lower bound for the six dep https://review.openstack.org/52233 | 22:40 |
*** ruhe has joined #savanna | 22:50 | |
*** ruhe has quit IRC | 22:51 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 22:52 | |
*** _SergeyLukjanov is now known as SergeyLukjanov | 22:52 | |
*** sacharya has joined #savanna | 23:29 | |
openstackgerrit | A change was merged to openstack/savanna: Add lower bound for the six dep https://review.openstack.org/52234 | 23:29 |
*** SergeyLukjanov has quit IRC | 23:49 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!