| *** aabashkin_ has joined #openstack-sahara | 00:47 | |
| *** AlexeyAbashkin has quit IRC | 00:48 | |
| *** chlong_ has joined #openstack-sahara | 01:12 | |
| *** chlong has joined #openstack-sahara | 01:12 | |
| *** jamielennox is now known as jamielennox|away | 02:00 | |
| *** jamielennox|away is now known as jamielennox | 02:04 | |
| *** anshul has joined #openstack-sahara | 04:47 | |
| *** pgadiya has joined #openstack-sahara | 04:50 | |
| *** chlong_ has quit IRC | 05:03 | |
| *** chlong has quit IRC | 05:03 | |
| *** chlong_ has joined #openstack-sahara | 05:16 | |
| *** chlong has joined #openstack-sahara | 05:20 | |
| *** chlong has quit IRC | 05:25 | |
| *** rcernin has joined #openstack-sahara | 05:33 | |
| *** shuyingya has quit IRC | 05:46 | |
| *** houming has joined #openstack-sahara | 05:57 | |
| *** sudipto has joined #openstack-sahara | 06:01 | |
| *** sudipto_ has joined #openstack-sahara | 06:01 | |
| *** chlong_ has quit IRC | 06:05 | |
| *** shuyingya has joined #openstack-sahara | 06:20 | |
| *** nkrinner_afk is now known as nkrinner | 06:45 | |
| *** pcaruana has joined #openstack-sahara | 06:49 | |
| *** tesseract- has joined #openstack-sahara | 07:00 | |
| *** vgridnev has joined #openstack-sahara | 07:43 | |
| *** esikachev has joined #openstack-sahara | 07:55 | |
| *** esikachev has quit IRC | 08:05 | |
| openstackgerrit | Michael Lelyakin proposed openstack/sahara-dashboard: Fix DataSource integration test https://review.openstack.org/368619 | 08:08 |
|---|---|---|
| *** aabashkin_ is now known as AlexeyAbashkin | 08:20 | |
| *** AlexeyAbashkin has quit IRC | 08:22 | |
| *** vgridnev has quit IRC | 08:30 | |
| *** _degorenko|afk is now known as degorenko | 08:31 | |
| *** vgridnev has joined #openstack-sahara | 08:34 | |
| *** AlexeyAbashkin has joined #openstack-sahara | 08:42 | |
| *** esikachev has joined #openstack-sahara | 08:51 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara-dashboard: Fix DataSource integration test https://review.openstack.org/368619 | 09:03 |
| *** openstackgerrit has quit IRC | 09:04 | |
| *** openstackgerrit has joined #openstack-sahara | 09:05 | |
| *** hoonetorg has joined #openstack-sahara | 09:05 | |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Added cli tests for job binary https://review.openstack.org/346687 | 09:06 |
| *** abalutoiu has joined #openstack-sahara | 09:07 | |
| openstackgerrit | Michael Ionkin proposed openstack/sahara: [DOC] update doc about CDH image builder https://review.openstack.org/368069 | 09:10 |
| openstackgerrit | Merged openstack/sahara: Remove entry point of sahara tempest plugin https://review.openstack.org/368447 | 09:11 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara-extra: migrate artifacts to sahara-extra https://review.openstack.org/368662 | 09:18 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara-extra: migrate artifacts to sahara-extra https://review.openstack.org/368662 | 09:20 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara-extra: migrate artifacts to sahara-extra https://review.openstack.org/368662 | 09:27 |
| *** esikachev has quit IRC | 09:31 | |
| *** houming has quit IRC | 09:31 | |
| *** tosky has joined #openstack-sahara | 09:35 | |
| openstackgerrit | Merged openstack/sahara-tests: Added tests for job types https://review.openstack.org/347144 | 09:35 |
| openstackgerrit | Merged openstack/sahara-tests: Use session to create Sahara Client in tests https://review.openstack.org/364379 | 09:38 |
| tosky | vgridnev: hi! About the jar cleanup, I don't think it will be possible to add the toolchain to cleanly compile the jar for Newton, but my goal is at least to document where the source code for each jar lives | 09:51 |
| tosky | vgridnev: iirc there are two jars which you wrote (according the etherpad), would you like to add the source code to the repository? | 09:51 |
| vgridnev | tosky, I will try to work on it right after finishing documentation notes about Kerberos | 09:52 |
| tosky | vgridnev: thanks | 09:53 |
| vgridnev | tosky, do we want to create a tag for sahara-tests around Newton release? | 09:54 |
| tosky | vgridnev: yes, for sure; I'd like to have CLI tests working too | 09:55 |
| openstackgerrit | Merged openstack/sahara-tests: Adapt plugin to use new tempest stable interface https://review.openstack.org/362074 | 10:08 |
| *** anshul has quit IRC | 10:14 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: write docs about enabling kerberos https://review.openstack.org/368716 | 10:18 |
| openstackgerrit | Merged openstack/sahara-dashboard: Fix DataSource integration test https://review.openstack.org/368619 | 10:19 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: write docs about enabling kerberos https://review.openstack.org/368716 | 10:21 |
| *** anshul has joined #openstack-sahara | 10:29 | |
| *** tellesnobrega has joined #openstack-sahara | 10:36 | |
| *** anshul has quit IRC | 10:40 | |
| *** rodrigods has quit IRC | 10:47 | |
| *** rodrigods has joined #openstack-sahara | 10:47 | |
| *** anshul has joined #openstack-sahara | 10:53 | |
| sudipto | Hello there, is there a good documentation on how to get started on swift + sahara integration? | 11:03 |
| *** anshul has quit IRC | 11:03 | |
| *** hoonetorg has quit IRC | 11:03 | |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Added Nightly Map Reduce job for vanilla https://review.openstack.org/367959 | 11:06 |
| vgridnev | sudipto, actually no additional actions should be required to reach out this integration. | 11:08 |
| openstackgerrit | Kirill Bespalov proposed openstack/sahara: Remove enable_notifications option https://review.openstack.org/368747 | 11:10 |
| *** anshul has joined #openstack-sahara | 11:15 | |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Added cli tests for job binary https://review.openstack.org/346687 | 11:15 |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Added cli tests for data sources https://review.openstack.org/346714 | 11:23 |
| openstackgerrit | Michael Ionkin proposed openstack/sahara: [Ambari] fix Ubuntu deploy https://review.openstack.org/358579 | 11:32 |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Added verification of cluster to scenario-framework https://review.openstack.org/357256 | 11:37 |
| *** anshul has quit IRC | 11:37 | |
| sudipto | vgridnev, thanks. treat me as a novice here, but this integration just needs a swift cluster and no cinder project involvement right? | 11:44 |
| sudipto | since swifts would be used here... | 11:46 |
| openstackgerrit | Raissa Sarmento proposed openstack/sahara-tests: Test fix for CLI tests https://review.openstack.org/368083 | 11:47 |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Added cli-tests for job template https://review.openstack.org/346749 | 11:50 |
| *** anshul has joined #openstack-sahara | 11:50 | |
| vgridnev | sudipto, you have to enable swift, and you still can use cinder for hdfs storage | 11:53 |
| sudipto | vgridnev, do we need hdfs at all? | 11:53 |
| vgridnev | why not? | 11:53 |
| sudipto | ok | 11:53 |
| sudipto | I thought if we use swiftfs we would no longer need hdfs | 11:54 |
| vgridnev | So, if you want to use swift fs a default filesystem, you have to manually configure default.fs for such case. | 11:56 |
| vgridnev | But I'm not sure if it's really needed have it default | 11:57 |
| sudipto | vgridnev, thanks for the info, i am a total novice in this area, is there a deployment guide for me to read? | 11:57 |
| vgridnev | deployment guide of what? | 11:58 |
| sudipto | sahara with swift. My understanding is that hdfs is the distributed fs used for hadoop and it can be swapped with swiftfs - if we want the swift benefits for the filesystem. Is that correct? | 11:59 |
| vgridnev | yep. But as I said, no additional actions needed. You just have to deploy sahara as usual, swift. If swift is in service catalog, sahara will put needed configs to core-site.xml so that you will be able to use swift fs for storing your daya | 12:02 |
| vgridnev | data* | 12:02 |
| sudipto | vgridnev, that's great! Thanks for the help. I will try this out! | 12:04 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: write docs about enabling kerberos https://review.openstack.org/368716 | 12:04 |
| vgridnev | ok, you are always welcome | 12:05 |
| openstackgerrit | Raissa Sarmento proposed openstack/sahara-tests: Use default plugin instead of fake https://review.openstack.org/367385 | 12:06 |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Added cli-tests with "job" command https://review.openstack.org/347148 | 12:08 |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Added cli-tests with "job" command https://review.openstack.org/347148 | 12:09 |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Added cli tests for data sources https://review.openstack.org/346714 | 12:09 |
| openstackgerrit | Michael Ionkin proposed openstack/sahara: [DOC] update user doc about CDH plugin https://review.openstack.org/368796 | 12:19 |
| openstackgerrit | guangpei.liu proposed openstack/sahara-tests: Update home-page https://review.openstack.org/368799 | 12:20 |
| tosky | vgridnev: uh, is this really fixed? The review was abandoned: https://bugs.launchpad.net/sahara/+bug/1619275 | 12:37 |
| openstack | Launchpad bug 1619275 in Sahara "ambari plugin is failed on CI because Oozie is failed to be started" [Critical,Fix released] - Assigned to Vitaly Gridnev (vgridnev) | 12:37 |
| openstackgerrit | guangpei.liu proposed openstack/sahara-dashboard: Drop unused directory in tox https://review.openstack.org/368814 | 12:37 |
| vgridnev | tosky, so, the issue was around auto configurations, so I just provided ability to use 'NEVER_APPLY' strategy for clusters | 12:40 |
| tosky | ah, that thing | 12:40 |
| tosky | it was not clear from the bug how it was fixed :) | 12:40 |
| vgridnev | tosky, I will put additional info to the bug | 12:42 |
| tosky | thanks! | 12:42 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: write docs about enabling kerberos https://review.openstack.org/368716 | 12:51 |
| *** vgridnev has quit IRC | 12:52 | |
| openstackgerrit | Michael Lelyakin proposed openstack/sahara-dashboard: Resolve bug with long time for loading node group template page https://review.openstack.org/333273 | 12:56 |
| *** pgadiya has quit IRC | 12:56 | |
| *** vgridnev has joined #openstack-sahara | 12:56 | |
| *** vgridnev has quit IRC | 13:02 | |
| *** vgridnev has joined #openstack-sahara | 13:04 | |
| openstackgerrit | Michael Ionkin proposed openstack/sahara: [Ambari] fix Ubuntu deploy https://review.openstack.org/358579 | 13:09 |
| tosky | raissa: about https://review.openstack.org/#/c/368083/, are both changes needed? I thought that only changing the credentials was enough, or is the automatic cleanup needed as well? | 13:10 |
| *** egafford has quit IRC | 13:11 | |
| raissa | tosky: hm, yeah, it's not really needed for this review, I can remove it. but I think it should be added anyway (in another review) since this test is not cleaning after itself when the test skips because of empty floating ip pool | 13:13 |
| tosky | raissa: that could be part of the fix which fixes (!) the skip for empty floating ip pool | 13:13 |
| raissa | heheh yes | 13:14 |
| openstackgerrit | Raissa Sarmento proposed openstack/sahara-tests: Test fix for CLI tests https://review.openstack.org/368083 | 13:15 |
| *** openstackgerrit has quit IRC | 13:19 | |
| *** openstackgerrit has joined #openstack-sahara | 13:20 | |
| tosky | does anyone have a devstack/master to check https://review.openstack.org/#/c/367129/ ? It seems that the format of the json changed (see my last comment) | 13:26 |
| vgridnev | tosky, looking on this change | 13:29 |
| vgridnev | tosky, what do you mean by "format of json changed" ? | 13:32 |
| tosky | vgridnev: what does `openstack dataprocessing plugin show -f json <random_plugin>` contains? I see different values with two versions of python-saharaclient (or maybe osc?) | 13:34 |
| tosky | also, that tests (if I read the code correctly) seems to look for 'Plugin: enabled' in the json, but I don't see it | 13:35 |
| vgridnev | 'Plugin: enabled' will be in output of openstack dataprocessing plugin show <plugin> actually | 13:40 |
| vgridnev | Not in json | 13:41 |
| vgridnev | I think | 13:41 |
| tosky | uhm, I don't see it (on mitaka at least) | 13:41 |
| vgridnev | but plugin's update API is available only since newton | 13:41 |
| tosky | ah | 13:42 |
| vgridnev | it's expected | 13:42 |
| vgridnev | moreover | 13:42 |
| tosky | so we need some way to enable it (some capability in tempest configuration probably) | 13:42 |
| vgridnev | Is it true that this test will be running in parallel with some other tests? | 13:42 |
| tosky | by default yes | 13:43 |
| vgridnev | If so, we can just put this test, because I'm sure it will not work in case when you are creating clusters with disabled plugin (temporary by the test) | 13:44 |
| vgridnev | And that is pity | 13:44 |
| tosky | maybe some other field can be updated | 13:45 |
| *** elmiko has joined #openstack-sahara | 13:45 | |
| vgridnev | yep, we can do | 13:46 |
| tosky | raissa: about https://review.openstack.org/#/c/368083/ again :) in the new stable interface, is the magic like "cls.os_admin.credentials" not supported? | 13:51 |
| openstackgerrit | Michael Lelyakin proposed openstack/sahara: [Doc] Small fixes according to Spark on Vanilla supporting https://review.openstack.org/368859 | 13:55 |
| *** anshul has quit IRC | 13:55 | |
| openstackgerrit | Merged openstack/sahara-dashboard: Drop unused directory in tox https://review.openstack.org/368814 | 14:01 |
| *** lelyakin has joined #openstack-sahara | 14:01 | |
| raissa | tosky: it is - I tried using it there and it didn't work, but it was actually because something is missing as I see now | 14:04 |
| raissa | I'll change it again | 14:04 |
| tosky | oh, ok | 14:04 |
| tosky | thanks | 14:04 |
| openstackgerrit | Raissa Sarmento proposed openstack/sahara-tests: Test fix for CLI tests https://review.openstack.org/368083 | 14:05 |
| *** egafford has joined #openstack-sahara | 14:11 | |
| vgridnev | egafford, FYI https://review.openstack.org/#/c/368662/ | 14:19 |
| egafford | vgridnev: \o/ | 14:19 |
| *** esikachev has joined #openstack-sahara | 14:19 | |
| vgridnev | egafford, some artifacts are stored per branch (hadoop-openstack) and some (common-artifacts) a stored separately | 14:20 |
| tellesnobrega | have anyone of you seen this 2016-09-12 11:24:35.893 16125 DEBUG sahara.utils.ssh_remote "Executing "ls .ssh/authorized_keys"" took 1.0 seconds to complete _log_command /home/tenobreg/upstream/sahara/sahara/sahara/utils/ssh_remote.py:927 | 14:27 |
| tellesnobrega | 2016-09-12 11:24:35.894 16125 DEBUG sahara.service.engine Can't login to node, IP: 10.0.0.15, reason KeyError: 'csahara.utils.ssh_remote\n | 14:27 |
| openstackgerrit | Merged openstack/sahara-extra: migrate artifacts to sahara-extra https://review.openstack.org/368662 | 14:28 |
| vgridnev | tellesnobrega, nope | 14:28 |
| vgridnev | is it fresh master? | 14:28 |
| tellesnobrega | it is | 14:28 |
| tellesnobrega | this is a setup where I run sahara apart from devstack and connect them both | 14:29 |
| tellesnobrega | but this started happening and I still haven't figured out why | 14:29 |
| tellesnobrega | the thing that bugs me the most is the csahara | 14:29 |
| vgridnev | tellesnobrega, what cluster you are trying to setup? | 14:30 |
| vgridnev | or it doesn't matter? | 14:31 |
| tellesnobrega | currently mapr on rhel 7 | 14:31 |
| tellesnobrega | I tried with mapr on centos7 the same thing happened | 14:31 |
| tellesnobrega | I will try vanilla hadoop and see what happens | 14:31 |
| vgridnev | I think it doesn't matter actually | 14:34 |
| vgridnev | so, actually issue is around https://github.com/openstack/sahara/blob/62df4993f4466bf806d5f05f42b45acbb66eab1f/sahara/service/engine.py#L122 | 14:35 |
| raissa | tosky: it worked, much simpler :) thanks for bringing that up | 14:35 |
| tosky | raissa: \o/ | 14:36 |
| tellesnobrega | vgridnev, yes, that's the point the problem occurs | 14:36 |
| *** hoonetorg has joined #openstack-sahara | 14:38 | |
| openstackgerrit | Michael Lelyakin proposed openstack/sahara-dashboard: Resolve bug with long time for loading node group template page https://review.openstack.org/333273 | 14:39 |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Added test for job update using cli https://review.openstack.org/348871 | 14:39 |
| openstackgerrit | Michael Lelyakin proposed openstack/sahara-dashboard: Resolve bug with long time for loading node group template page https://review.openstack.org/333273 | 14:41 |
| *** vgridnev has quit IRC | 15:07 | |
| *** esikachev has quit IRC | 15:08 | |
| *** emccormick has quit IRC | 15:11 | |
| *** esikachev has joined #openstack-sahara | 15:15 | |
| *** nkrinner is now known as nkrinner_afk | 15:20 | |
| *** vgridnev has joined #openstack-sahara | 15:22 | |
| *** abalutoiu has quit IRC | 15:31 | |
| *** emccormick has joined #openstack-sahara | 15:35 | |
| openstackgerrit | Merged openstack/sahara-tests: Update home-page https://review.openstack.org/368799 | 15:40 |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Fixed bug with registration of image in sahara-tests https://review.openstack.org/368937 | 15:45 |
| *** vgridnev has quit IRC | 15:50 | |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Added verification of cluster to scenario-framework https://review.openstack.org/357256 | 15:53 |
| *** rcernin has quit IRC | 15:53 | |
| *** pcaruana has quit IRC | 15:56 | |
| *** emccormick has quit IRC | 15:56 | |
| *** thumpba has joined #openstack-sahara | 16:06 | |
| *** sudipto has quit IRC | 16:22 | |
| *** sudipto_ has quit IRC | 16:22 | |
| *** abalutoiu has joined #openstack-sahara | 16:25 | |
| *** tosky has quit IRC | 16:29 | |
| *** emccormick has joined #openstack-sahara | 16:31 | |
| *** degorenko is now known as _degorenko|afk | 16:31 | |
| *** vgridnev has joined #openstack-sahara | 16:35 | |
| openstackgerrit | Michael Ionkin proposed openstack/sahara: [DOC] update user doc about CDH plugin https://review.openstack.org/368796 | 16:37 |
| *** vgridnev has quit IRC | 16:41 | |
| *** tesseract- has quit IRC | 16:56 | |
| *** vgridnev has joined #openstack-sahara | 17:03 | |
| *** vgridnev has quit IRC | 17:04 | |
| *** vgridnev has joined #openstack-sahara | 17:12 | |
| openstackgerrit | Merged openstack/sahara-tests: Test fix for CLI tests https://review.openstack.org/368083 | 17:18 |
| *** ukaynar has joined #openstack-sahara | 17:27 | |
| *** vgridnev has quit IRC | 17:33 | |
| *** sudipto has joined #openstack-sahara | 17:38 | |
| *** sudipto_ has joined #openstack-sahara | 17:38 | |
| *** vgridnev has joined #openstack-sahara | 17:54 | |
| openstackgerrit | Raissa Sarmento proposed openstack/sahara-tests: Remove hardcoded config values in CLI tests https://review.openstack.org/364865 | 17:55 |
| *** tenobreg has joined #openstack-sahara | 17:57 | |
| *** abalutoiu has quit IRC | 17:59 | |
| *** tellesnobrega has quit IRC | 18:00 | |
| *** esikachev has quit IRC | 18:17 | |
| *** sudipto has quit IRC | 18:18 | |
| *** sudipto_ has quit IRC | 18:18 | |
| vgridnev | egafford, https://review.openstack.org/#/q/status:open+project:openstack/sahara+branch:master+topic:docs | 18:26 |
| *** ukaynar has quit IRC | 18:26 | |
| egafford | vgridnev: Excellent; will review (and add the suggestion to add "docs" as the topic to the etherpad) | 18:27 |
| *** vgridnev has quit IRC | 18:55 | |
| *** pcaruana has joined #openstack-sahara | 19:04 | |
| *** vgridnev has joined #openstack-sahara | 19:25 | |
| *** vgridnev has quit IRC | 19:33 | |
| *** vgridnev has joined #openstack-sahara | 19:34 | |
| *** esikachev has joined #openstack-sahara | 20:16 | |
| *** thumpba has quit IRC | 20:27 | |
| *** thumpba has joined #openstack-sahara | 20:29 | |
| openstackgerrit | Merged openstack/sahara: [Doc] Small fixes according to Spark on Vanilla supporting https://review.openstack.org/368859 | 20:41 |
| *** pcaruana has quit IRC | 20:46 | |
| *** esikachev has quit IRC | 21:26 | |
| *** vgridnev has quit IRC | 21:45 | |
| *** thumpba has quit IRC | 21:49 | |
| *** emccormick has quit IRC | 21:51 | |
| *** zigo has quit IRC | 22:08 | |
| *** zigo has joined #openstack-sahara | 22:11 | |
| *** zigo is now known as Guest41388 | 22:11 | |
| *** Guest41388 is now known as zigo_ | 22:17 | |
| *** thumpba has joined #openstack-sahara | 22:19 | |
| *** egafford has quit IRC | 22:24 | |
| *** thumpba has quit IRC | 22:24 | |
| *** openstackgerrit has quit IRC | 22:48 | |
| *** openstackgerrit has joined #openstack-sahara | 22:49 | |
| *** elmiko is now known as _elmiko | 22:57 | |
| raissa | /away | 23:07 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!