openstackgerrit | li,chen proposed openstack/sahara: Restrict cluster to have at most one secondary namenode https://review.openstack.org/171064 | 00:39 |
---|---|---|
*** stanchan has quit IRC | 01:09 | |
openstackgerrit | lu huichun proposed openstack/sahara: Adding config hints for CDH plugin https://review.openstack.org/169466 | 01:19 |
openstackgerrit | lu huichun proposed openstack/sahara: Adding config hints for CDH plugin https://review.openstack.org/169466 | 01:45 |
openstackgerrit | lu huichun proposed openstack/sahara: Adding config hints for CDH plugin https://review.openstack.org/169466 | 01:45 |
openstackgerrit | lu huichun proposed openstack/sahara: Adding config hints for CDH plugin https://review.openstack.org/169466 | 01:51 |
openstackgerrit | lu huichun proposed openstack/sahara: Adding config hints for CDH plugin https://review.openstack.org/169466 | 01:51 |
openstackgerrit | lu huichun proposed openstack/sahara: Add CDH template for the scenario integration test https://review.openstack.org/171909 | 02:01 |
*** ruhe has quit IRC | 02:48 | |
*** ruhe has joined #openstack-sahara | 02:48 | |
*** ruhe has quit IRC | 03:06 | |
*** ruhe has joined #openstack-sahara | 03:13 | |
*** stanchan has joined #openstack-sahara | 04:57 | |
openstackgerrit | lu huichun proposed openstack/sahara: Adding config hints for CDH plugin https://review.openstack.org/169466 | 05:10 |
*** mahito has joined #openstack-sahara | 05:10 | |
*** sreshetn1 has joined #openstack-sahara | 05:14 | |
*** Poornima has joined #openstack-sahara | 05:21 | |
*** Nikolay_1t has quit IRC | 05:40 | |
*** sreshetn1 has quit IRC | 05:46 | |
*** sgotliv has joined #openstack-sahara | 05:46 | |
*** Longgeek has joined #openstack-sahara | 05:53 | |
*** sreshetn1 has joined #openstack-sahara | 05:56 | |
*** tnovacik has joined #openstack-sahara | 06:02 | |
*** sgotliv has quit IRC | 06:05 | |
*** hdd has joined #openstack-sahara | 06:10 | |
*** sreshetn1 has quit IRC | 06:52 | |
*** sreshetn1 has joined #openstack-sahara | 07:00 | |
*** jamielennox is now known as jamielennox|away | 07:02 | |
*** hdd has quit IRC | 07:07 | |
*** hdd has joined #openstack-sahara | 07:08 | |
openstackgerrit | lu huichun proposed openstack/sahara: Adding config hints for CDH plugin https://review.openstack.org/169466 | 07:13 |
openstackgerrit | Sergey Reshetnyak proposed openstack/python-saharaclient: Provide user-agent in saharaclient https://review.openstack.org/171968 | 07:22 |
*** chlong has quit IRC | 07:27 | |
openstackgerrit | Sergey Reshetnyak proposed openstack/python-saharaclient: Add regions support to saharaclient https://review.openstack.org/171734 | 07:30 |
*** witlessb has joined #openstack-sahara | 07:30 | |
*** pino|work has joined #openstack-sahara | 07:57 | |
openstackgerrit | lu huichun proposed openstack/sahara: [CDH] swift lib support https://review.openstack.org/173205 | 08:16 |
*** sgotliv has joined #openstack-sahara | 08:26 | |
*** Nikolay_St has joined #openstack-sahara | 08:32 | |
*** sgotliv has quit IRC | 08:36 | |
*** sgotliv has joined #openstack-sahara | 08:36 | |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: [WIP] Use keystone session in new integration tests https://review.openstack.org/169295 | 08:36 |
openstackgerrit | Nikolay Starodubtsev proposed openstack/sahara: Add handler for configuration w/o sec groups https://review.openstack.org/172884 | 08:54 |
openstackgerrit | Denis Egorenko proposed openstack/sahara: Put in Sahara repo actual scenario files https://review.openstack.org/172513 | 08:57 |
openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Use scenario files from Sahara repository https://review.openstack.org/172666 | 09:04 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Use jsonutils from oslo.serialization https://review.openstack.org/172083 | 09:16 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Use jsonutils from oslo.serialization https://review.openstack.org/172083 | 09:18 |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: [WIP] Use keystone session in new integration tests https://review.openstack.org/169295 | 09:33 |
*** tosky has joined #openstack-sahara | 09:44 | |
*** esikachev has joined #openstack-sahara | 09:53 | |
openstackgerrit | Denis Egorenko proposed openstack/sahara: Put in Sahara repo actual scenario files https://review.openstack.org/172513 | 09:55 |
*** mahito has quit IRC | 10:07 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara-specs: Spec for deprecation of direct engine https://review.openstack.org/173251 | 10:25 |
*** sreshetn1 has quit IRC | 10:26 | |
*** Poornima has quit IRC | 10:29 | |
*** chen12 has joined #openstack-sahara | 10:51 | |
*** sreshetn1 has joined #openstack-sahara | 10:57 | |
*** sreshetn1 has quit IRC | 11:08 | |
*** sreshetn1 has joined #openstack-sahara | 11:44 | |
*** sreshetn1 has quit IRC | 11:51 | |
*** sgotliv has quit IRC | 12:02 | |
*** sgotliv has joined #openstack-sahara | 12:15 | |
*** sreshetn1 has joined #openstack-sahara | 12:16 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara-specs: Spec for deprecation of direct engine https://review.openstack.org/173251 | 12:54 |
*** _crobertsrh is now known as crobertsrh | 13:16 | |
*** sgotliv has quit IRC | 13:30 | |
*** sgotliv has joined #openstack-sahara | 13:30 | |
*** coolsvap|afk is now known as coolsvap | 13:34 | |
*** tmckay has joined #openstack-sahara | 13:34 | |
openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Fix tempest job https://review.openstack.org/173324 | 13:46 |
*** Nikolay_St has quit IRC | 14:08 | |
*** stanchan has quit IRC | 14:25 | |
tmckay | elmiko, crobertsrh, on the summit etherpad, "sprint topics" align with the design summit description how? Pod discussions, contributors meetup topics? | 14:27 |
crobertsrh | I think sprint topics are things that might be "quickies" for the half-day | 14:27 |
*** tosky has quit IRC | 14:27 | |
tmckay | ok, that was my guess | 14:27 |
elmiko | yea, agree with crobertsrh | 14:29 |
elmiko | sprints i think are for friday | 14:29 |
*** tnovacik has quit IRC | 14:31 | |
crobertsrh | Ooh, only 35 days until Vancouver | 14:32 |
elmiko | man, time flies lol | 14:32 |
*** tosky has joined #openstack-sahara | 14:32 | |
*** sgotliv has quit IRC | 14:41 | |
*** sgotliv has joined #openstack-sahara | 14:53 | |
*** hdd has quit IRC | 14:54 | |
SergeyLukjanov | <tmckay>elmiko, crobertsrh sprint == meetup style on Friday and we have the whole day this time | 14:59 |
*** Nikolay_St has joined #openstack-sahara | 14:59 | |
tmckay | SergeyLukjanov, thanks. So, for setting priorities, do you think we should schedule a working session, or just try to do during the meetup? I'm thinking of EDP. | 15:00 |
*** coolsvap is now known as coolsvap|afk | 15:00 | |
elmiko | also, did you guys see this http://lists.openstack.org/pipermail/openstack-dev/2015-April/061167.html | 15:01 |
elmiko | proposed slot allocation | 15:01 |
tmckay | Ah, interesting. Okay. | 15:04 |
tmckay | we've already got more than 5 | 15:04 |
*** tnovacik has joined #openstack-sahara | 15:05 | |
*** sreshetn1 has quit IRC | 15:05 | |
elmiko | well, that's proposed, so i wonder if we might get more if we add more the pad? | 15:05 |
*** Nikolay_St has quit IRC | 15:06 | |
*** sreshetn1 has joined #openstack-sahara | 15:07 | |
*** Nikolay_St has joined #openstack-sahara | 15:08 | |
openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Zuul layout.yaml improvements https://review.openstack.org/166209 | 15:09 |
*** Nikolay_St has quit IRC | 15:15 | |
*** Nikolay_St has joined #openstack-sahara | 15:16 | |
*** Nikolay_St has quit IRC | 15:22 | |
*** Nikolay_St has joined #openstack-sahara | 15:25 | |
*** Longgeek has quit IRC | 15:29 | |
*** Nikolay_St has quit IRC | 15:30 | |
*** Nikolay_St has joined #openstack-sahara | 15:32 | |
openstackgerrit | Trevor McKay proposed openstack/sahara: Add a brief description of the default template mechanism https://review.openstack.org/171747 | 15:44 |
*** Longgeek has joined #openstack-sahara | 16:00 | |
*** Longgeek has quit IRC | 16:01 | |
*** Longgeek has joined #openstack-sahara | 16:01 | |
*** Nikolay_St has quit IRC | 16:03 | |
*** stanchan has joined #openstack-sahara | 16:05 | |
*** Longgeek has quit IRC | 16:06 | |
*** Nikolay_St has joined #openstack-sahara | 16:15 | |
*** sreshetn1 has quit IRC | 16:17 | |
*** sreshetn1 has joined #openstack-sahara | 16:18 | |
*** Nikolay_St has quit IRC | 16:26 | |
*** sreshetn1 has quit IRC | 16:27 | |
*** IBerezovskiy has quit IRC | 16:30 | |
*** sgotliv has quit IRC | 16:49 | |
*** esikachev has quit IRC | 17:01 | |
openstackgerrit | lu huichun proposed openstack/sahara-image-elements: Start switching to declarative package-installs https://review.openstack.org/167150 | 17:04 |
openstackgerrit | lu huichun proposed openstack/sahara-image-elements: missing swift lib in cdh plugin https://review.openstack.org/173419 | 17:04 |
openstackgerrit | lu huichun proposed openstack/sahara-image-elements: missing swift lib in cdh plugin https://review.openstack.org/173419 | 17:06 |
openstackgerrit | lu huichun proposed openstack/sahara: Adding config hints for CDH plugin https://review.openstack.org/169466 | 17:11 |
openstackgerrit | lu huichun proposed openstack/sahara: Adding config hints for CDH plugin https://review.openstack.org/169466 | 17:11 |
*** saurabhs has joined #openstack-sahara | 17:25 | |
*** hdd has joined #openstack-sahara | 17:41 | |
*** hdd has quit IRC | 18:01 | |
tmckay | crobertsrh, what do you think of adding edit for data sources and job binaries? My use case is you launch a job, and find out that your swift path was wrong (or your credentials). so you want to just tweak the path and relaunch. Can't do that right now. You have to create a new data source. | 18:02 |
crobertsrh | Hmm | 18:02 |
crobertsrh | They aren't particularly hard to create (not many steps), but we could probably add it. | 18:03 |
tmckay | I would even lift any restriction that you can't edit if it's currently referenced. Because any job in the Running state already has pulled the info from the objects. | 18:03 |
crobertsrh | I suppose if there were several binaries referenced and you needed to tweak one, that might be ugly to totally re-create | 18:03 |
tmckay | no, not particularly hard. But if you can relaunch the job execution, which already references it, and just tweak the path, it's super easy | 18:04 |
crobertsrh | Worth an add to the Liberty list and see where it shakes out priority-wise | 18:04 |
tmckay | crobertsrh, the other thing is to fix up relaunch. In some cases, values don't show up on the relaunch tab. You end up having to re-enter them. I forget which, I'll have to file a bug. | 18:05 |
crobertsrh | Oh, yeah, that's probably a bug | 18:05 |
*** jamielennox|away is now known as jamielennox | 18:05 | |
crobertsrh | Probably values that were added after the relaunch was first put in | 18:06 |
tmckay | I was looking on Thurs for rough edges while I was running Java jobs, and these things all happened to me :) | 18:06 |
crobertsrh | awesome | 18:06 |
tmckay | crobertsrh, ack | 18:06 |
crobertsrh | If I were really clever, I'd find a way to not have to update the relaunch bits whenever a new item was added. | 18:06 |
tmckay | crobertsrh, other thought was validating swift paths when you create the data source. "Hey, that doesn't exist. I'll make it anyway, but ..." | 18:07 |
tmckay | so you have a clue before you run the thing | 18:07 |
crobertsrh | I like that | 18:07 |
crobertsrh | Also, making sure that your output DS is clean before running and barfing because it wasn't | 18:07 |
tmckay | crobertsrh, ^^ ack on the clever. Maybe something is missing from the API, maybe it can be part of the V2 discussion. Is there an op you need? Is there something that should be added to a job execution object? | 18:08 |
tmckay | crobertsrh, agreed on the output. | 18:08 |
crobertsrh | Not sure what exactly we'd need. The job_ex object really just crams stuff into a few fields | 18:08 |
tmckay | and, if you do any of this stuff with a transient cluster, woe is you | 18:08 |
crobertsrh | I might just be able to do better inspection of the job_ex object and params and configs, etc and add fields with their defaults, assuming that I can figure out what sort of field they need to be | 18:09 |
crobertsrh | So, more generally, we want better upfront validation of everything that we can validate as soon as it can be validated. | 18:10 |
tmckay | crobertsrh, actually, if you read egafford's spec on job interface mapping https://blueprints.launchpad.net/sahara/+spec/unified-job-interface-map that might spark ideas. If we get that implemented, and we know how configs/args/params map to the job, maybe it will be a guide for the UI on relaunch | 18:12 |
tmckay | I validate your statement | 18:12 |
crobertsrh | Yeah, that is probably a good starting point | 18:12 |
tmckay | crobertsrh, alright, thanks, I'll make blueprints for data source and job binary editing. | 18:14 |
crobertsrh | Sounds good | 18:14 |
*** tosky has quit IRC | 18:14 | |
crobertsrh | Let me know when you're done, I'll add the corresponding bps for horizon. | 18:14 |
tmckay | ok | 18:14 |
*** tellesnobrega has quit IRC | 18:25 | |
*** tellesnobrega has joined #openstack-sahara | 18:26 | |
*** tellesnobrega_ has joined #openstack-sahara | 18:27 | |
*** tellesnobrega_ has quit IRC | 18:27 | |
*** tellesnobrega has quit IRC | 18:29 | |
*** tellesnobrega has joined #openstack-sahara | 18:29 | |
tellesnobrega | tmckay, it's almost ready for not being a wip https://review.openstack.org/#/c/168302/ | 18:33 |
tellesnobrega | crobertsrh, sahara interface's code is integrated with horizon? | 18:34 |
crobertsrh | yes | 18:34 |
crobertsrh | under openstack_dashboard/dashboards/project/data_processing | 18:34 |
openstackgerrit | Andrew Lazarev proposed openstack/sahara: Implemented support of placeholders in datasource URLs https://review.openstack.org/158909 | 18:34 |
*** sreshetn1 has joined #openstack-sahara | 18:36 | |
tmckay | tellesnobrega, thanks, I'll check it out | 18:36 |
tellesnobrega | crobertsrh | 18:36 |
tellesnobrega | tmckay, i have to change the commit message | 18:36 |
tellesnobrega | i wrote about UI, but it needs to be a separated patch | 18:37 |
tellesnobrega | thanks | 18:37 |
*** pino|work has quit IRC | 18:43 | |
*** chen12 has quit IRC | 19:08 | |
*** sgotliv has joined #openstack-sahara | 19:21 | |
*** sreshetn1 has quit IRC | 19:40 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/173490 | 19:53 |
*** sreshetn1 has joined #openstack-sahara | 19:57 | |
*** Nikolay_St has joined #openstack-sahara | 20:29 | |
*** hdd has joined #openstack-sahara | 20:53 | |
*** tmckay has left #openstack-sahara | 20:58 | |
*** sreshetn1 has quit IRC | 21:03 | |
*** crobertsrh is now known as _crobertsrh | 21:04 | |
*** hdd has quit IRC | 21:04 | |
openstackgerrit | lu huichun proposed openstack/sahara: Adding config hints for CDH plugin https://review.openstack.org/169466 | 21:07 |
*** sreshetn1 has joined #openstack-sahara | 21:07 | |
openstackgerrit | lu huichun proposed openstack/sahara: Adding config hints for CDH plugin https://review.openstack.org/169466 | 21:08 |
openstackgerrit | Emilien Macchi proposed stackforge/puppet-sahara: Synchronize LICENSE file with OpenStack projects https://review.openstack.org/173530 | 21:14 |
*** sgotliv has quit IRC | 21:31 | |
*** sreshetn1 has quit IRC | 21:44 | |
*** tnovacik has quit IRC | 21:57 | |
*** witlessb has quit IRC | 22:29 | |
*** chlong has joined #openstack-sahara | 23:10 | |
*** chlong has quit IRC | 23:43 | |
*** chlong has joined #openstack-sahara | 23:45 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!