*** IlyaE has joined #savanna | 00:11 | |
*** IlyaE has quit IRC | 00:21 | |
*** IlyaE has joined #savanna | 00:39 | |
*** IlyaE has quit IRC | 00:50 | |
*** dina_belova has joined #savanna | 00:50 | |
*** NikitaKonovalov has joined #savanna | 00:54 | |
*** dina_belova has quit IRC | 00:55 | |
*** IlyaE has joined #savanna | 00:57 | |
*** NikitaKonovalov has quit IRC | 00:58 | |
*** IlyaE has quit IRC | 01:05 | |
*** dina_belova has joined #savanna | 01:52 | |
*** NikitaKonovalov has joined #savanna | 01:55 | |
*** dina_belova has quit IRC | 01:56 | |
*** NikitaKonovalov has quit IRC | 01:59 | |
*** SergeyLukjanov has joined #savanna | 02:50 | |
*** dina_belova has joined #savanna | 02:51 | |
*** NikitaKonovalov has joined #savanna | 02:56 | |
*** NikitaKonovalov has quit IRC | 03:00 | |
*** SergeyLukjanov has quit IRC | 03:05 | |
*** dina_belova has quit IRC | 03:15 | |
*** IlyaE has joined #savanna | 03:54 | |
*** NikitaKonovalov has joined #savanna | 03:56 | |
*** NikitaKonovalov has quit IRC | 04:01 | |
*** IlyaE has quit IRC | 04:15 | |
*** IlyaE has joined #savanna | 04:19 | |
*** NikitaKonovalov has joined #savanna | 04:57 | |
*** _mattf is now known as mattf | 05:00 | |
*** NikitaKonovalov has quit IRC | 05:01 | |
*** dina_belova has joined #savanna | 05:15 | |
*** IlyaE has quit IRC | 05:15 | |
*** dina_belova has quit IRC | 05:16 | |
*** lastidiot has quit IRC | 05:20 | |
*** dina_belova has joined #savanna | 05:25 | |
*** tmckayrh has quit IRC | 05:26 | |
*** IlyaE has joined #savanna | 05:37 | |
*** dina_belova has quit IRC | 05:52 | |
*** aignatov has quit IRC | 06:04 | |
*** aignatov has joined #savanna | 06:04 | |
*** NikitaKonovalov has joined #savanna | 06:11 | |
*** dina_belova has joined #savanna | 06:20 | |
*** dina_belova has quit IRC | 06:25 | |
*** mattf has quit IRC | 06:44 | |
*** dina_belova has joined #savanna | 06:44 | |
*** dina_belova has quit IRC | 06:50 | |
*** NikitaKonovalov has quit IRC | 06:53 | |
*** dina_belova has joined #savanna | 06:55 | |
*** IlyaE has quit IRC | 06:58 | |
*** NikitaKonovalov has joined #savanna | 07:04 | |
*** dina_belova has quit IRC | 07:08 | |
*** aignatov has quit IRC | 07:09 | |
*** IlyaE has joined #savanna | 07:09 | |
*** aignatov has joined #savanna | 07:10 | |
*** IlyaE has quit IRC | 07:14 | |
*** NikitaKonovalov has quit IRC | 07:28 | |
*** NikitaKonovalov has joined #savanna | 07:47 | |
*** nprivalova has joined #savanna | 07:56 | |
*** dina_belova has joined #savanna | 07:59 | |
*** SergeyLukjanov has joined #savanna | 07:59 | |
*** NikitaKo_ has joined #savanna | 08:02 | |
*** NikitaKonovalov has quit IRC | 08:04 | |
*** NikitaKo_ has quit IRC | 08:04 | |
*** NikitaKonovalov has joined #savanna | 08:04 | |
*** dina_belova has quit IRC | 08:10 | |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/python-savannaclient: Python Savanna Client initial implementation https://review.openstack.org/38261 | 08:14 |
---|---|---|
*** dina_belova has joined #savanna | 08:28 | |
*** ruhe has joined #savanna | 08:44 | |
*** dmitryme has joined #savanna | 08:56 | |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna-dashboard: Fix skipping node_group_id if not specified https://review.openstack.org/39652 | 08:56 |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna-dashboard: Fix skipping node_group_id if not specified https://review.openstack.org/39652 | 08:57 |
openstackgerrit | A change was merged to stackforge/savanna: Ambari install screen after install fix https://review.openstack.org/39375 | 09:12 |
openstackgerrit | A change was merged to stackforge/savanna-dashboard: Fix skipping node_group_id if not specified https://review.openstack.org/39652 | 09:23 |
*** NikitaKonovalov has quit IRC | 09:33 | |
*** NikitaKonovalov has joined #savanna | 09:36 | |
*** NikitaKonovalov has quit IRC | 09:42 | |
*** dina_belova has quit IRC | 09:57 | |
*** ruhe has quit IRC | 10:04 | |
*** nprivalova has quit IRC | 10:22 | |
*** SergeyLukjanov has quit IRC | 10:41 | |
*** NikitaKonovalov has joined #savanna | 10:42 | |
*** ruhe has joined #savanna | 10:45 | |
*** NikitaKonovalov has quit IRC | 10:46 | |
*** nprivalova has joined #savanna | 10:52 | |
openstackgerrit | Alexander Ignatov proposed a change to stackforge/savanna: Resolves critical issue with oozie service https://review.openstack.org/39666 | 10:57 |
*** dina_belova has joined #savanna | 10:58 | |
*** dina_belova has quit IRC | 11:02 | |
*** NikitaKonovalov has joined #savanna | 11:10 | |
*** dina_belova has joined #savanna | 11:11 | |
*** SergeyLukjanov has joined #savanna | 11:11 | |
openstackgerrit | Alexander Ignatov proposed a change to stackforge/savanna-extra: Added Oozie DIB element https://review.openstack.org/39671 | 11:26 |
openstackgerrit | Alexander Ignatov proposed a change to stackforge/savanna-extra: Added Oozie DIB element https://review.openstack.org/39671 | 11:28 |
openstackgerrit | Alexander Ignatov proposed a change to stackforge/savanna-extra: Added Oozie DIB element https://review.openstack.org/39671 | 11:36 |
*** dmitryme has quit IRC | 12:06 | |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Initial part of conductor implementation https://review.openstack.org/39270 | 12:22 |
*** ruhe has quit IRC | 12:32 | |
*** NikitaKonovalov has quit IRC | 12:43 | |
*** NikitaKonovalov has joined #savanna | 12:47 | |
*** dmitryme has joined #savanna | 12:50 | |
*** ruhe has joined #savanna | 12:54 | |
*** _tstclair is now known as tstclair | 12:58 | |
*** ruhe has quit IRC | 12:59 | |
*** _mattf has joined #savanna | 13:00 | |
*** _mattf is now known as mattf | 13:01 | |
*** mattf has joined #savanna | 13:01 | |
*** dmitryme has quit IRC | 13:32 | |
*** tmckayrh has joined #savanna | 13:33 | |
tmckayrh | SergeyLukjanov, fyi, just because I mentioned it yesterday -- the http connection to the Swift REST api did not work because apparently whatever httpie is doing to resolve host names does not work with "localhost". I've had similar issues in Python before, I believe (something to do with httplib or urllib). | 13:37 |
openstackgerrit | Jonathan Maron proposed a change to stackforge/savanna: Fix to convert parsing failure https://review.openstack.org/39553 | 13:48 |
*** NikitaKonovalov has quit IRC | 13:53 | |
*** dmitryme has joined #savanna | 13:58 | |
*** SergeyLukjanov has quit IRC | 14:01 | |
*** NikitaKonovalov has joined #savanna | 14:02 | |
*** NikitaKonovalov has quit IRC | 14:15 | |
*** lastidiot has joined #savanna | 14:22 | |
openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Refactoring remote utils https://review.openstack.org/39043 | 14:23 |
*** dmitryme_ has joined #savanna | 14:29 | |
*** dmitryme has quit IRC | 14:31 | |
*** dmitryme_ is now known as dmitryme | 14:31 | |
*** lastidiot has quit IRC | 14:34 | |
*** dina_belova has quit IRC | 14:39 | |
*** NikitaKonovalov has joined #savanna | 14:46 | |
*** NikitaKonovalov has quit IRC | 14:55 | |
*** ruhe has joined #savanna | 14:57 | |
*** SergeyLukjanov has joined #savanna | 14:59 | |
*** lastidiot has joined #savanna | 15:09 | |
*** NikitaKonovalov has joined #savanna | 15:16 | |
openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Refactoring hdp plugin https://review.openstack.org/39733 | 15:18 |
*** dina_belova has joined #savanna | 15:19 | |
openstackgerrit | A change was merged to stackforge/savanna: Initial part of conductor implementation https://review.openstack.org/39270 | 15:22 |
*** rnirmal has joined #savanna | 15:37 | |
*** dina_belova has quit IRC | 15:47 | |
*** SergeyLukjanov has quit IRC | 15:48 | |
*** NikitaKonovalov has quit IRC | 15:50 | |
*** dmitryme has quit IRC | 15:55 | |
*** dmitryme has joined #savanna | 15:57 | |
openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Refactoring remote utils https://review.openstack.org/39043 | 15:59 |
*** IlyaE has joined #savanna | 16:01 | |
*** ruhe has quit IRC | 16:01 | |
*** dmitryme has quit IRC | 16:19 | |
*** dina_belova has joined #savanna | 16:20 | |
*** SergeyLukjanov has joined #savanna | 16:25 | |
*** dmitryme has joined #savanna | 16:26 | |
*** dmitryme has quit IRC | 16:38 | |
*** ruhe has joined #savanna | 16:39 | |
*** NikitaKonovalov has joined #savanna | 16:46 | |
*** NikitaKonovalov has quit IRC | 16:51 | |
*** mattf is now known as _mattf | 16:52 | |
*** _mattf is now known as mattf | 16:54 | |
*** ruhe has quit IRC | 16:56 | |
*** ben_duyujie has joined #savanna | 17:03 | |
*** NikitaKonovalov has joined #savanna | 17:13 | |
*** nprivalova has quit IRC | 17:27 | |
*** ben_duyujie has quit IRC | 17:31 | |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Port sqlalchemy db models to conductor https://review.openstack.org/39756 | 17:31 |
*** ben_duyujie has joined #savanna | 17:33 | |
*** dina_belova has quit IRC | 17:43 | |
*** IlyaE has quit IRC | 17:45 | |
*** Nadya has joined #savanna | 17:52 | |
SergeyLukjanov | savanna meeting will be in #openstack-meeting-alt channel in 7 minutes | 17:58 |
*** dmitryme has joined #savanna | 17:58 | |
*** aignatov_ has joined #savanna | 18:02 | |
*** NikitaKonovalov has quit IRC | 18:02 | |
*** NikitaKonovalov has joined #savanna | 18:02 | |
*** benl_ has joined #savanna | 18:05 | |
*** Nadya_ has joined #savanna | 18:05 | |
*** akuznetsov has joined #savanna | 18:05 | |
*** Nadya has quit IRC | 18:06 | |
*** IlyaE has joined #savanna | 18:07 | |
*** ben_duyujie has quit IRC | 18:08 | |
*** benl__ has joined #savanna | 18:11 | |
*** benl_ has quit IRC | 18:12 | |
*** ruhe has joined #savanna | 18:19 | |
*** ruhe_ has joined #savanna | 18:36 | |
*** ruhe has quit IRC | 18:37 | |
*** dina_belova has joined #savanna | 18:43 | |
*** _crobertsrh has quit IRC | 18:45 | |
*** dina_belova has quit IRC | 18:49 | |
*** dina_belova has joined #savanna | 18:54 | |
SergeyLukjanov | benl__, what's your lp id? | 19:03 |
SergeyLukjanov | (to assign PKI bp to you) | 19:03 |
benl__ | Hmm ben-lapid I think | 19:04 |
*** tmckayrh is now known as tmckay_latelunch | 19:04 | |
SergeyLukjanov | done - https://blueprints.launchpad.net/savanna/+spec/pki-support | 19:05 |
benl__ | Cool, so whats the current situation? Savanna works with the old Tokens and not PKI? | 19:05 |
SergeyLukjanov | benl__, yep | 19:06 |
SergeyLukjanov | benl__, we are using keystone client's middleware for auth | 19:06 |
benl__ | Okay. I'll start digging into it | 19:07 |
SergeyLukjanov | and afaik it should provide auth for both uuid and poi tokens... | 19:07 |
benl__ | Hmm, Shouldn't that support PKI out of the box? | 19:07 |
SergeyLukjanov | benl__, great, thank you! | 19:07 |
SergeyLukjanov | benl__, I think it should:) | 19:07 |
benl__ | I see, I'll investigate :) | 19:08 |
*** aignatov_ has quit IRC | 19:11 | |
tmckay_latelunch | Nadya_, re your comment "<Nadya_> tmckayrh, if you have questions about swift integration please post your question in irc. I dealt with swift in savanna" | 19:17 |
*** tmckay_latelunch is now known as tmckay | 19:17 | |
*** tmckay is now known as tmckayrh | 19:17 | |
*** NikitaKonovalov has quit IRC | 19:18 | |
Nadya_ | yes, I'm hrer | 19:19 |
Nadya_ | *here | 19:19 |
tmckayrh | Nadya_, I am wondering what swift integration there is in savanna already. I installed swift as part of an openstack instance on a development machine | 19:20 |
*** NikitaKonovalov has joined #savanna | 19:21 | |
tmckayrh | ah, I found the swift subdir... | 19:21 |
Nadya_ | oh, It's a long story :) The thing is swift is not integrated with hadoop. To make them work together it is needed to put jar file with swift FileSystem impl to hadoop libs | 19:22 |
tmckayrh | I think I saw some comments about that... | 19:22 |
*** akuznetsov has quit IRC | 19:22 | |
Nadya_ | did you find docs about it? | 19:22 |
tmckayrh | I forget where.... something mentioned it, with links to issues | 19:23 |
tmckayrh | swift+hadoop | 19:23 |
Nadya_ | give me a second I will find | 19:24 |
tmckayrh | But, whatever packstack did on my box, swift is running at least well enough to interact with using the python client or http so I thought that would be adequate for API development | 19:24 |
*** benl__ has quit IRC | 19:24 | |
Nadya_ | http://savanna.readthedocs.org/en/latest/userdoc/hadoop-swift.html | 19:27 |
tmckayrh | ah yes, that's it | 19:27 |
*** dina_belova has quit IRC | 19:29 | |
Nadya_ | could you please explain what kind of integration are you implementing? what part? pushing jobs "binaris" to and from swift? | 19:30 |
*** benl_ has joined #savanna | 19:31 | |
dmitryme | tmckayrh | 19:32 |
Nadya_ | patching is needed only for interacting with Hadoop. e.g. if you want to run job and get data from swift | 19:32 |
dmitryme | tmckayrh: here are some more words about integration with Swift | 19:32 |
dmitryme | https://savanna.readthedocs.org/en/latest/userdoc/features.html | 19:32 |
dmitryme | In particular, here is described how one should compose Swift URL | 19:33 |
tmckayrh | Nadya_, yes, I am working on implementing the Job Origin (formerly Job Source) api in savanna. So, the first part will be registering sources. There is supposed to be a call to retrieve a job, though -- that will ultimately be a download from swift | 19:34 |
tmckayrh | "registering origins" excuse me | 19:34 |
tmckayrh | Nadya_, as of yet, the blueprint doesn't say anything about pushing jobs, only retrieving them | 19:34 |
benl_ | Nadya_, is there a particular reason to patch hadoop instead of using a Swift filesystem over FUSE? | 19:34 |
tmckayrh | So I'm assuming that someone would push jobs to swift externally with another client | 19:35 |
*** NikitaKonovalov has quit IRC | 19:35 | |
*** NikitaKonovalov has joined #savanna | 19:36 | |
tmckayrh | Swift is the first job origin type to support. Then of course there are the scm variants, and internal savanna storage, etc. I started with swift on Sergey's suggestion (I think it was him :) Maybe ruhe) | 19:36 |
Nadya_ | tmckayrh, are you going to copy jobs from swift to hdfs? | 19:36 |
*** rnirmal has quit IRC | 19:36 | |
Nadya_ | I mean jobs' "binaries" | 19:36 |
tmckayrh | Nadya_, not sure. I haven't dived into the details of "get a binary" too much yet. Still learning savanna internals. | 19:37 |
*** benl__ has joined #savanna | 19:38 | |
tmckayrh | could be, I suppose. The sequence diagram is very high level -- what does "Job Manager retrieves binary" really mean? | 19:38 |
tmckayrh | Nadya_, maybe we should chat about that. How will your Oozie flows want to see binaries? Where will it look? | 19:39 |
Nadya_ | tmckayrh, let's assume we have pig script. May it be on swift? And what will we do with it? I thought that on this itegation we are not working with this scenario | 19:40 |
dmitryme | benl_: for Vanilla plugin we are preparing an image with Hadoop anyway. So it is easier to put patch here at build time | 19:40 |
Nadya_ | tmckayrh, the working scenario is only "data to be processes is on swift" | 19:40 |
benl__ | I see. cheers | 19:40 |
tmckayrh | Nadya_, so in the case of an Ooozie workflow.xml, where would you want it to be? | 19:41 |
tmckayrh | hdfs? | 19:42 |
*** benl_ has quit IRC | 19:42 | |
Nadya_ | tmckayrh, it should be in HDFS I believe. We thought about variant of storing it into swift but not sure if we have time to implement it | 19:42 |
*** dina_belova has joined #savanna | 19:44 | |
tmckayrh | Nadya_, okay, I can do that. Is the difficulty with using Swift the integration that you pointed out earlier? | 19:44 |
*** ruhe_ has quit IRC | 19:45 | |
Nadya_ | tmckayrh, it is absolutly possible to store scripts and workflow xml in swift. The problem is only in resources to implement it. Yes, problem is in integration. Anyway, we will think about it | 19:47 |
tmckayrh | okay | 19:48 |
Nadya_ | ruhe managed to run swift-located scripts | 19:48 |
Nadya_ | but he didn't tell me how :) | 19:48 |
tmckayrh | :) I just played with the swift cli for upload/download, I thought "Great!" | 19:49 |
tmckayrh | I can store it, and I can read it back. | 19:49 |
Nadya_ | yes, it is. but it is not so simple for hadoop scenario :) e.g. try to copy from swift to hdfs | 19:50 |
mattf | SergeyLukjanov, IlyaE, fyi, i added some placeholders to the roadmap page | 19:50 |
tmckayrh | Nadya_, thank you for pointing this out. | 19:50 |
SergeyLukjanov | mattf, yep, see it, thank you | 19:51 |
*** benl__ has quit IRC | 19:52 | |
SergeyLukjanov | mattf, I think that incubation request should removed from the list of tech improvements and ubuntu should be added to the integration target | 19:52 |
Nadya_ | tmckayrh, you are welcome! anyway, I will evaluate the complexity of running scripts and jars directly from swift. Maybe it is scaring only at first glance | 19:54 |
tmckayrh | Nadya_, haha, that is my trouble -- I don't know enough yet to be scared :) Still on the "peaches and rose petals" part of the learning curve | 19:55 |
Nadya_ | tmckayrh, :) | 19:57 |
mattf | SergeyLukjanov, where would you put the statement about when we'd like to submit an incubation request? | 20:02 |
mattf | SergeyLukjanov, good call wrt ubuntu, slipped my mind | 20:02 |
*** dina_belova has quit IRC | 20:06 | |
*** benl_ has joined #savanna | 20:07 | |
*** dina_belova has joined #savanna | 20:08 | |
*** Nadya_ has quit IRC | 20:13 | |
*** crobertsrh has joined #savanna | 20:15 | |
*** crobertsrh has left #savanna | 20:17 | |
*** crobertsrh has joined #savanna | 20:17 | |
*** dina_belova has quit IRC | 20:18 | |
*** rnirmal has joined #savanna | 20:19 | |
*** IlyaE has quit IRC | 20:33 | |
*** IlyaE has joined #savanna | 20:50 | |
*** mattf is now known as _mattf | 20:59 | |
*** SergeyLukjanov has quit IRC | 21:00 | |
*** benl_ has quit IRC | 21:01 | |
*** IlyaE has quit IRC | 21:06 | |
*** benl_ has joined #savanna | 21:06 | |
*** NikitaKonovalov has quit IRC | 21:12 | |
crobertsrh | Sorry for bailing on the meeting earlier. My internet connection dropped just after the "Job Origin" vote. I went ahead and created the blueprint for edp-savanna-dashboard-ui. I can add more detail if desired https://blueprints.launchpad.net/savanna/+spec/edp-savanna-dashboard-ui | 21:18 |
*** tstclair is now known as _tstclair | 21:20 | |
*** dmitryme has quit IRC | 21:21 | |
*** openstackgerrit has quit IRC | 21:25 | |
*** openstackgerrit has joined #savanna | 21:25 | |
benl_ | Hey, anyone around? I could use some help in setting up savanna | 21:28 |
*** dina_belova has joined #savanna | 21:29 | |
crobertsrh | benl_: Have you checked out https://savanna.readthedocs.org/en/latest/ | 21:29 |
benl_ | Yup, followed everything | 21:30 |
crobertsrh | Then you're all set, right? :) | 21:30 |
benl_ | I'm having the same issue as this guy: https://lists.launchpad.net/savanna-all/msg00028.html | 21:30 |
benl_ | Yet when I try to do the 'service-create' thing, I get "Unable to authorize user" | 21:30 |
benl_ | (I exported OS_USERNAME and OS_PASSWORD to the admin user, and OS_AUTH_URL to port 35357) | 21:31 |
crobertsrh | ah, that was my next question | 21:31 |
benl_ | :) | 21:31 |
benl_ | That should be a part of https://savanna.readthedocs.org/en/latest/horizon/installation.guide.html right? | 21:32 |
benl_ | or is it only in specific setups? | 21:32 |
benl_ | (Im using devstack, with PKI instead of UUID and some neutron, ceilometer and heat stuff enabled) | 21:33 |
crobertsrh | I'm afraid I might not be of much help. I just started working with savanna recently. I haven't had a lot of exposure to every part of the system yet. | 21:33 |
*** dina_belova has quit IRC | 21:33 | |
benl_ | Thats alright, thanks anyway | 21:34 |
crobertsrh | Hopefully, someone with more expertise can chime in | 21:34 |
crobertsrh | Good luck | 21:36 |
*** crobertsrh is now known as _crobertsrh | 21:36 | |
*** ben_duyujie has joined #savanna | 21:47 | |
*** NikitaKonovalov has joined #savanna | 22:13 | |
*** rnirmal has quit IRC | 22:15 | |
*** NikitaKonovalov has quit IRC | 22:17 | |
*** lastidiot has quit IRC | 22:21 | |
*** aignatov has quit IRC | 22:25 | |
*** aignatov has joined #savanna | 22:26 | |
*** nmakhotkin has quit IRC | 22:28 | |
*** benl_ has quit IRC | 22:32 | |
*** benl_ has joined #savanna | 22:32 | |
*** nmakhotkin has joined #savanna | 22:42 | |
*** IlyaE has joined #savanna | 22:45 | |
*** IlyaE has quit IRC | 22:52 | |
*** IlyaE has joined #savanna | 22:53 | |
*** IlyaE has quit IRC | 22:55 | |
*** benl_ has quit IRC | 22:55 | |
*** NikitaKonovalov has joined #savanna | 23:13 | |
*** NikitaKonovalov has quit IRC | 23:18 | |
*** benl_ has joined #savanna | 23:26 | |
*** benl_ has quit IRC | 23:33 | |
*** _mattf is now known as mattf | 23:51 | |
*** lastidiot has joined #savanna | 23:52 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!