| *** tnovacik has quit IRC | 00:08 | |
| *** tellesnobrega_ has joined #openstack-sahara | 02:20 | |
| *** chandankumar has joined #openstack-sahara | 04:40 | |
| *** Poornima has joined #openstack-sahara | 04:46 | |
| *** chandankumar has quit IRC | 04:55 | |
| *** Longgeek has joined #openstack-sahara | 05:21 | |
| *** Longgeek has quit IRC | 05:27 | |
| *** k4n0 has joined #openstack-sahara | 06:00 | |
| *** chandankumar has joined #openstack-sahara | 06:14 | |
| *** tellesnobrega_ has quit IRC | 06:37 | |
| *** Longgeek has joined #openstack-sahara | 07:05 | |
| openstackgerrit | Ken Chen proposed openstack/sahara: Add CDH plugin documents https://review.openstack.org/136697 | 07:15 |
|---|---|---|
| *** oz__ has quit IRC | 07:21 | |
| openstackgerrit | Ken Chen proposed openstack/sahara: Use first_run to Start Services https://review.openstack.org/134471 | 08:03 |
| *** miqui_ has quit IRC | 08:05 | |
| *** skolekonov has joined #openstack-sahara | 08:15 | |
| *** witlessb has joined #openstack-sahara | 09:17 | |
| *** tnovacik has joined #openstack-sahara | 09:18 | |
| *** IvanBerezovskiy has joined #openstack-sahara | 09:22 | |
| *** Longgeek has quit IRC | 09:35 | |
| openstackgerrit | Merged openstack/sahara: Replacing data_processing with data-processing https://review.openstack.org/135472 | 09:39 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/136720 | 09:50 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara-dashboard: Updated from global requirements https://review.openstack.org/136721 | 09:50 |
| *** Longgeek has joined #openstack-sahara | 09:51 | |
| openstackgerrit | Sergey Lukjanov proposed openstack/python-saharaclient: Remove node group tmpl update function https://review.openstack.org/136726 | 10:01 |
| openstackgerrit | Sergey Lukjanov proposed openstack/python-saharaclient: Remove cluster tmpl update function https://review.openstack.org/136727 | 10:02 |
| openstackgerrit | Merged openstack/sahara-specs: Added specification for event log and logs improvements https://review.openstack.org/119052 | 10:28 |
| openstackgerrit | Merged openstack/sahara: Fixed bug with Hive jobs fail https://review.openstack.org/133952 | 11:01 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add db/conductor ops to work with new events objects https://review.openstack.org/133458 | 11:03 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: And new endpoint and periodic task with events ops https://review.openstack.org/134504 | 11:06 |
| *** tosky has joined #openstack-sahara | 11:07 | |
| *** Poornima has quit IRC | 11:32 | |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Add list of open ports for Spark plugin https://review.openstack.org/134927 | 11:33 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add provision steps for direct engine https://review.openstack.org/134490 | 11:42 |
| openstackgerrit | Merged openstack/sahara: Support query filtering for cluster objects https://review.openstack.org/135683 | 11:42 |
| openstackgerrit | Merged openstack/sahara: Support query filtering for templates and EDP objects https://review.openstack.org/135723 | 11:42 |
| openstackgerrit | Merged openstack/sahara: Pylint check was broken after pylint update https://review.openstack.org/135464 | 11:42 |
| openstackgerrit | Merged openstack/python-saharaclient: Replacing data_processing with data-processing https://review.openstack.org/135148 | 11:49 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add provision steps for direct engine https://review.openstack.org/134490 | 11:51 |
| *** chandankumar has quit IRC | 11:56 | |
| openstackgerrit | Merged openstack/python-saharaclient: Add Support for Keystone V3 CLI https://review.openstack.org/114669 | 11:59 |
| *** chandankumar has joined #openstack-sahara | 12:01 | |
| openstackgerrit | Merged openstack/sahara: Print Cloudera manager logs if integration test failed https://review.openstack.org/133519 | 12:06 |
| openstackgerrit | Merged openstack/sahara: Add link on Hue Dashboard for CDH plugin https://review.openstack.org/133457 | 12:06 |
| openstackgerrit | Adrien Vergé proposed openstack/sahara: Mount volumes with options for HDFS performance https://review.openstack.org/136746 | 12:23 |
| openstackgerrit | Merged openstack/sahara-dashboard: Updated from global requirements https://review.openstack.org/136721 | 12:31 |
| openstackgerrit | Abbass Marouni proposed openstack/sahara: Enable HDFS NameNode High Availability with HDP 2.0.6 plugin https://review.openstack.org/132051 | 12:46 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: And new endpoint and periodic task with events ops https://review.openstack.org/134504 | 12:56 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add db/conductor ops to work with new events objects https://review.openstack.org/133458 | 12:56 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add new events objects to Sahara https://review.openstack.org/133006 | 12:56 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add provision steps to Vanilla plugin https://review.openstack.org/136748 | 12:56 |
| *** k4n0 has quit IRC | 13:00 | |
| openstackgerrit | Merged openstack/sahara: Updated from global requirements https://review.openstack.org/136720 | 13:14 |
| openstackgerrit | Merged openstack/sahara: Added checks on deleting cluster https://review.openstack.org/136180 | 13:14 |
| *** zhiyan has quit IRC | 13:24 | |
| *** zhiyan has joined #openstack-sahara | 13:27 | |
| *** ylobankov has joined #openstack-sahara | 13:33 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add provision steps to Vanilla plugin https://review.openstack.org/136748 | 13:39 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add provision steps to Vanilla 1 plugin https://review.openstack.org/136748 | 13:42 |
| *** _mattf is now known as mattf | 13:42 | |
| SergeyLukjanov | tellesnobrega, _crobertsrh, I've added https://review.openstack.org/136735 to replace data_pr with data-pr in devstack | 13:46 |
| SergeyLukjanov | IMO it should be merged after the new client release | 13:46 |
| tellesnobrega | ok | 13:47 |
| tellesnobrega | i already had a patch for this change https://review.openstack.org/#/c/135454/ | 13:49 |
| _crobertsrh | ack | 13:49 |
| *** _crobertsrh is now known as crobertsrh | 13:49 | |
| SergeyLukjanov | tellesnobrega, oh, abandoning my one :) | 13:49 |
| tellesnobrega | ok | 13:50 |
| tellesnobrega | i agree that this has to wait for the client release | 13:50 |
| tellesnobrega | i have a patch for tempest as well | 13:50 |
| tellesnobrega | i think we have a little problem with devstack and tempest | 13:52 |
| tellesnobrega | tempest uses devstack to test right? and devstack uses tempest? | 13:52 |
| SergeyLukjanov | tellesnobrega, yup | 14:01 |
| tellesnobrega | so, the problem is, the tempest will fail since devstack still uses data_processing | 14:01 |
| tellesnobrega | and devstack will fail since tempest still uses data_processing | 14:01 |
| *** egafford has joined #openstack-sahara | 14:05 | |
| *** chandankumar has quit IRC | 14:12 | |
| *** tellesnobrega has quit IRC | 14:19 | |
| *** tellesnobrega has joined #openstack-sahara | 14:19 | |
| SergeyLukjanov | tellesnobrega, yeah, I'll take a look on how it could be resolved | 14:20 |
| tellesnobrega | a college had a similar problem, what he did was, committed the tempest test that were failing with a skip | 14:21 |
| tellesnobrega | then we could commit the devstack | 14:22 |
| tellesnobrega | and then we can commit the tempest tests again | 14:22 |
| SergeyLukjanov | tellesnobrega, for us it'll mean to skip all sahara test :) | 14:22 |
| tellesnobrega | kkk | 14:22 |
| tellesnobrega | we may need a better approach | 14:24 |
| openstackgerrit | Andrey Pavlov proposed openstack/python-saharaclient: Added unit tests for python bindings https://review.openstack.org/134167 | 14:48 |
| openstackgerrit | Abbass Marouni proposed openstack/sahara: Enable HDFS NameNode High Availability with HDP 2.0.6 plugin https://review.openstack.org/132051 | 14:57 |
| openstackgerrit | Andrey Pavlov proposed openstack/python-saharaclient: Saharaclient tests for tempest https://review.openstack.org/130767 | 14:59 |
| *** tmckay has joined #openstack-sahara | 15:04 | |
| *** tosky_ has joined #openstack-sahara | 15:25 | |
| *** tosky has quit IRC | 15:29 | |
| openstackgerrit | Ethan Gafford proposed openstack/sahara: Sample JSON files for Sahara EDP APIs https://review.openstack.org/136530 | 15:35 |
| *** sreshetnyak has quit IRC | 15:52 | |
| *** egafford has quit IRC | 16:01 | |
| *** juice has quit IRC | 16:04 | |
| *** juice has joined #openstack-sahara | 16:07 | |
| *** Longgeek has quit IRC | 16:23 | |
| *** egafford has joined #openstack-sahara | 16:42 | |
| *** chandankumar has joined #openstack-sahara | 17:04 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding uuids to exceptions https://review.openstack.org/136826 | 17:04 |
| *** stannie has quit IRC | 17:16 | |
| *** egafford has quit IRC | 17:18 | |
| *** egafford has joined #openstack-sahara | 17:28 | |
| tmckay | croberts, should we update your query spec to include the special cluster.name and job.name kwargs for job execution search? | 17:35 |
| tmckay | patch is done, but maybe the spec should mention it | 17:35 |
| tmckay | crobertsrh ^^ | 17:35 |
| openstackgerrit | Trevor McKay proposed openstack/sahara: Support searching job executions by cluster name and job name https://review.openstack.org/136843 | 17:42 |
| openstackgerrit | Michael McCune proposed openstack/sahara-specs: Specification Repository Backlog Refactor https://review.openstack.org/135313 | 17:49 |
| crobertsrh | tmckay. I can do that. | 18:01 |
| *** ViswaV has joined #openstack-sahara | 18:24 | |
| *** chandankumar has quit IRC | 18:27 | |
| *** ViswaV has quit IRC | 18:31 | |
| *** ViswaV has joined #openstack-sahara | 18:33 | |
| tmckay | elmiko, egafford, ping | 19:00 |
| elmiko | tmckay: yo | 19:00 |
| tmckay | the JSON examples looks pretty good to me (one tiny comment). But, it uses old style credentials for Swift. Do we want to include an example assuming proxy user, or at least make a note about it in the README? | 19:01 |
| tmckay | I feel like we should steer people toward proxy at every opportunity | 19:01 |
| elmiko | tmckay: i thought about that, and i'm a no. my reasoning is two-fold | 19:02 |
| elmiko | 1. i think egafford did a nice job of presenting the idea that these templates represent a starting for newcomers to the project. as such they start from a basis of our older methodology. | 19:02 |
| elmiko | 2. proxy domain is still slightly "power-user" to configure, i think the examples will provide a nice point to say "hey if you configure this other stuff you can drop the creds." | 19:03 |
| tmckay | elmiko, okay, should there be a note to the effect of #2 in the README? At least to point to newbies, "hey, there's another way" ? | 19:04 |
| elmiko | if we ever get to the point where proxy domain is a standard part of install then i'd say we should revisit the examples | 19:04 |
| elmiko | tmckay: hmm, that's a good question. i don't have an immediate opinion. | 19:04 |
| openstackgerrit | Andrew Lazarev proposed openstack/sahara: Add indirect VMs access implementation https://review.openstack.org/133590 | 19:04 |
| tmckay | I'm on the fence. Just a simple "Note, if you don't want to pass swift credentials, see this XXXX" | 19:05 |
| elmiko | tmckay: i think it would be nice to have a little note that the creds can be avoided and provide a link to the advanced configuration section on proxy domains | 19:05 |
| elmiko | tmckay: yea, +1 | 19:05 |
| tmckay | okay, thanks, I'll add a comment. Realtime gerrit, love it :) | 19:05 |
| elmiko | lol | 19:06 |
| egafford | elmiko, tmckay: Thanks guys, good comments. | 19:11 |
| tmckay | egafford, np, looks great | 19:11 |
| openstackgerrit | Chad Roberts proposed openstack/sahara-specs: Updating query filtering support for Sahara https://review.openstack.org/136865 | 19:13 |
| *** mattf is now known as _mattf | 19:13 | |
| *** tosky_ has quit IRC | 19:25 | |
| egafford | #tmckay: Quick question on your comment: are Swift root paths (from containers) normally represented with a starting slash, or not so much? | 19:29 |
| egafford | Hm. I have hashed your nick for no good reason, possibly sabotaging my intent. tmckay: Please see previous line. | 19:30 |
| elmiko | egafford: from my experience it's usually "container/object", sometimes we use "swift://" to designate the swift sourcing. i believe we add the uri internally though. | 19:30 |
| egafford | Oh, yes, we do, it's just a question of how best to represent the path (separating container from path) for folks who may well be brand new to Swift. | 19:31 |
| elmiko | yea, i've always used the "container/object" | 19:32 |
| egafford | Cool. | 19:32 |
| elmiko | iirc the actual swift endpoints will be like that too | 19:32 |
| egafford | Yup, the URIs have to be formatted precisely that way. It's a question of how to document it in English to best communicate how containers and paths relate to the URI. You've answered the question, though; it sounds like it is better to use the starting slash in all cases for consistency with the URL. | 19:35 |
| elmiko | cool | 19:35 |
| tmckay | oops, missed the bing | 19:35 |
| egafford | tmckay: Bings are elusive beasts. | 19:36 |
| tmckay | egafford, I was just going to check this from the swift command line. I would go by what "swift list container" shows for a container that has objects in it | 19:37 |
| tmckay | my devstack broke, had to relaunch .. maybe it's there now | 19:37 |
| tmckay | yep :) | 19:37 |
| tmckay | doh, I have the wrong swiftclient it seems | 19:38 |
| tmckay | I think no leading "/" is the usual when talking about objects in containers, especially since the "/" is just sugar and actually has no import | 19:38 |
| tmckay | egafford, ^^ | 19:39 |
| egafford | tmckay: Cool (and what I was doing except for the one consistency miss.) Thanks. | 19:40 |
| tmckay | np, I meant to finish that comment with a suggestion but my stack is broken ... again ;-) | 19:41 |
| *** witlessb has quit IRC | 19:43 | |
| *** witlessb has joined #openstack-sahara | 19:44 | |
| egafford | I get the value of mimicking the CLI output, but to me, as a user new to Swift, I think "put this thing in container X, at path Y" is less likely to make me bang my head against user error for an hour than "put this thing into X/Y". The URIs are already there in the JSON files for the user to see, so the combination of the two will probably cement the relationship. I'll check once my devstack is up on how ``swift list thing`` pres | 19:46 |
| tmckay | great, /usr/bin/swift wants a version of python-swiftclient that apparently I can't get. Thanks devstack. | 19:48 |
| egafford | tmckay: Aw man. | 19:48 |
| tmckay | looks like there is a launchpad bug ... | 19:49 |
| tmckay | maybe not | 19:50 |
| elmiko | egafford: in general i agree with making it clear to the user that part of the url is the container and part is the object. especially in cases, like the examples, where a pseudo directory is used in the container. | 19:51 |
| *** tmckay has quit IRC | 19:54 | |
| egafford | Swift list has no starting slash. | 20:00 |
| openstackgerrit | Ethan Gafford proposed openstack/sahara: Sample JSON files for Sahara EDP APIs https://review.openstack.org/136530 | 20:14 |
| *** vrovachev has quit IRC | 20:20 | |
| *** vrovachev has joined #openstack-sahara | 20:21 | |
| *** ylobankov has quit IRC | 20:21 | |
| *** ylobankov has joined #openstack-sahara | 20:21 | |
| openstackgerrit | Merged openstack/sahara: Updated from global requirements https://review.openstack.org/136620 | 20:50 |
| openstackgerrit | Merged openstack/sahara: Fix for getting auth url for hadoop-swift https://review.openstack.org/135278 | 20:50 |
| *** tmckay has joined #openstack-sahara | 20:59 | |
| *** Networkn3rd has joined #openstack-sahara | 21:14 | |
| *** crobertsrh is now known as _crobertsrh | 21:43 | |
| *** egafford has quit IRC | 22:45 | |
| *** shakamunyi_ has joined #openstack-sahara | 22:55 | |
| *** shakamunyi_ has quit IRC | 23:04 | |
| openstackgerrit | Trevor McKay proposed openstack/sahara: Support searching job executions by cluster name and job name https://review.openstack.org/136843 | 23:25 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!