Tuesday, 2015-04-14

openstackgerritli,chen proposed openstack/sahara: Restrict cluster to have at most one secondary namenode  https://review.openstack.org/17106400:39
*** stanchan has quit IRC01:09
openstackgerritlu huichun proposed openstack/sahara: Adding config hints for CDH plugin  https://review.openstack.org/16946601:19
openstackgerritlu huichun proposed openstack/sahara: Adding config hints for CDH plugin  https://review.openstack.org/16946601:45
openstackgerritlu huichun proposed openstack/sahara: Adding config hints for CDH plugin  https://review.openstack.org/16946601:45
openstackgerritlu huichun proposed openstack/sahara: Adding config hints for CDH plugin  https://review.openstack.org/16946601:51
openstackgerritlu huichun proposed openstack/sahara: Adding config hints for CDH plugin  https://review.openstack.org/16946601:51
openstackgerritlu huichun proposed openstack/sahara: Add CDH template for the scenario integration test  https://review.openstack.org/17190902:01
*** ruhe has quit IRC02:48
*** ruhe has joined #openstack-sahara02:48
*** ruhe has quit IRC03:06
*** ruhe has joined #openstack-sahara03:13
*** stanchan has joined #openstack-sahara04:57
openstackgerritlu huichun proposed openstack/sahara: Adding config hints for CDH plugin  https://review.openstack.org/16946605:10
*** mahito has joined #openstack-sahara05:10
*** sreshetn1 has joined #openstack-sahara05:14
*** Poornima has joined #openstack-sahara05:21
*** Nikolay_1t has quit IRC05:40
*** sreshetn1 has quit IRC05:46
*** sgotliv has joined #openstack-sahara05:46
*** Longgeek has joined #openstack-sahara05:53
*** sreshetn1 has joined #openstack-sahara05:56
*** tnovacik has joined #openstack-sahara06:02
*** sgotliv has quit IRC06:05
*** hdd has joined #openstack-sahara06:10
*** sreshetn1 has quit IRC06:52
*** sreshetn1 has joined #openstack-sahara07:00
*** jamielennox is now known as jamielennox|away07:02
*** hdd has quit IRC07:07
*** hdd has joined #openstack-sahara07:08
openstackgerritlu huichun proposed openstack/sahara: Adding config hints for CDH plugin  https://review.openstack.org/16946607:13
openstackgerritSergey Reshetnyak proposed openstack/python-saharaclient: Provide user-agent in saharaclient  https://review.openstack.org/17196807:22
*** chlong has quit IRC07:27
openstackgerritSergey Reshetnyak proposed openstack/python-saharaclient: Add regions support to saharaclient  https://review.openstack.org/17173407:30
*** witlessb has joined #openstack-sahara07:30
*** pino|work has joined #openstack-sahara07:57
openstackgerritlu huichun proposed openstack/sahara: [CDH] swift lib support  https://review.openstack.org/17320508:16
*** sgotliv has joined #openstack-sahara08:26
*** Nikolay_St has joined #openstack-sahara08:32
*** sgotliv has quit IRC08:36
*** sgotliv has joined #openstack-sahara08:36
openstackgerritSergey Reshetnyak proposed openstack/sahara: [WIP] Use keystone session in new integration tests  https://review.openstack.org/16929508:36
openstackgerritNikolay Starodubtsev proposed openstack/sahara: Add handler for configuration w/o sec groups  https://review.openstack.org/17288408:54
openstackgerritDenis Egorenko proposed openstack/sahara: Put in Sahara repo actual scenario files  https://review.openstack.org/17251308:57
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Use scenario files from Sahara repository  https://review.openstack.org/17266609:04
openstackgerritVitaly Gridnev proposed openstack/sahara: Use jsonutils from oslo.serialization  https://review.openstack.org/17208309:16
openstackgerritVitaly Gridnev proposed openstack/sahara: Use jsonutils from oslo.serialization  https://review.openstack.org/17208309:18
openstackgerritSergey Reshetnyak proposed openstack/sahara: [WIP] Use keystone session in new integration tests  https://review.openstack.org/16929509:33
*** tosky has joined #openstack-sahara09:44
*** esikachev has joined #openstack-sahara09:53
openstackgerritDenis Egorenko proposed openstack/sahara: Put in Sahara repo actual scenario files  https://review.openstack.org/17251309:55
*** mahito has quit IRC10:07
openstackgerritVitaly Gridnev proposed openstack/sahara-specs: Spec for deprecation of direct engine  https://review.openstack.org/17325110:25
*** sreshetn1 has quit IRC10:26
*** Poornima has quit IRC10:29
*** chen12 has joined #openstack-sahara10:51
*** sreshetn1 has joined #openstack-sahara10:57
*** sreshetn1 has quit IRC11:08
*** sreshetn1 has joined #openstack-sahara11:44
*** sreshetn1 has quit IRC11:51
*** sgotliv has quit IRC12:02
*** sgotliv has joined #openstack-sahara12:15
*** sreshetn1 has joined #openstack-sahara12:16
openstackgerritVitaly Gridnev proposed openstack/sahara-specs: Spec for deprecation of direct engine  https://review.openstack.org/17325112:54
*** _crobertsrh is now known as crobertsrh13:16
*** sgotliv has quit IRC13:30
*** sgotliv has joined #openstack-sahara13:30
*** coolsvap|afk is now known as coolsvap13:34
*** tmckay has joined #openstack-sahara13:34
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Fix tempest job  https://review.openstack.org/17332413:46
*** Nikolay_St has quit IRC14:08
*** stanchan has quit IRC14:25
tmckayelmiko, crobertsrh, on the summit etherpad, "sprint topics" align with the design summit description how? Pod discussions, contributors meetup topics?14:27
crobertsrhI think sprint topics are things that might be "quickies" for the half-day14:27
*** tosky has quit IRC14:27
tmckayok, that was my guess14:27
elmikoyea, agree with crobertsrh14:29
elmikosprints i think are for friday14:29
*** tnovacik has quit IRC14:31
crobertsrhOoh, only 35 days until Vancouver14:32
elmikoman, time flies lol14:32
*** tosky has joined #openstack-sahara14:32
*** sgotliv has quit IRC14:41
*** sgotliv has joined #openstack-sahara14:53
*** hdd has quit IRC14:54
SergeyLukjanov<tmckay>elmiko, crobertsrh sprint == meetup style on Friday and we have the whole day this time14:59
*** Nikolay_St has joined #openstack-sahara14:59
tmckaySergeyLukjanov, thanks.  So, for setting priorities, do you think we should schedule a working session, or just try to do during the meetup? I'm thinking of EDP.15:00
*** coolsvap is now known as coolsvap|afk15:00
elmikoalso, did you guys see this http://lists.openstack.org/pipermail/openstack-dev/2015-April/061167.html15:01
elmikoproposed slot allocation15:01
tmckayAh, interesting.  Okay.15:04
tmckaywe've already got more than 515:04
*** tnovacik has joined #openstack-sahara15:05
*** sreshetn1 has quit IRC15:05
elmikowell, that's proposed, so i wonder if we might get more if we add more the pad?15:05
*** Nikolay_St has quit IRC15:06
*** sreshetn1 has joined #openstack-sahara15:07
*** Nikolay_St has joined #openstack-sahara15:08
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Zuul layout.yaml improvements  https://review.openstack.org/16620915:09
*** Nikolay_St has quit IRC15:15
*** Nikolay_St has joined #openstack-sahara15:16
*** Nikolay_St has quit IRC15:22
*** Nikolay_St has joined #openstack-sahara15:25
*** Longgeek has quit IRC15:29
*** Nikolay_St has quit IRC15:30
*** Nikolay_St has joined #openstack-sahara15:32
openstackgerritTrevor McKay proposed openstack/sahara: Add a brief description of the default template mechanism  https://review.openstack.org/17174715:44
*** Longgeek has joined #openstack-sahara16:00
*** Longgeek has quit IRC16:01
*** Longgeek has joined #openstack-sahara16:01
*** Nikolay_St has quit IRC16:03
*** stanchan has joined #openstack-sahara16:05
*** Longgeek has quit IRC16:06
*** Nikolay_St has joined #openstack-sahara16:15
*** sreshetn1 has quit IRC16:17
*** sreshetn1 has joined #openstack-sahara16:18
*** Nikolay_St has quit IRC16:26
*** sreshetn1 has quit IRC16:27
*** IBerezovskiy has quit IRC16:30
*** sgotliv has quit IRC16:49
*** esikachev has quit IRC17:01
openstackgerritlu huichun proposed openstack/sahara-image-elements: Start switching to declarative package-installs  https://review.openstack.org/16715017:04
openstackgerritlu huichun proposed openstack/sahara-image-elements: missing swift lib in cdh plugin  https://review.openstack.org/17341917:04
openstackgerritlu huichun proposed openstack/sahara-image-elements: missing swift lib in cdh plugin  https://review.openstack.org/17341917:06
openstackgerritlu huichun proposed openstack/sahara: Adding config hints for CDH plugin  https://review.openstack.org/16946617:11
openstackgerritlu huichun proposed openstack/sahara: Adding config hints for CDH plugin  https://review.openstack.org/16946617:11
*** saurabhs has joined #openstack-sahara17:25
*** hdd has joined #openstack-sahara17:41
*** hdd has quit IRC18:01
tmckaycrobertsrh, what do you think of adding edit for data sources and job binaries?  My use case is you launch a job, and find out that your swift path was wrong (or your credentials).  so you want to just tweak the path and relaunch.  Can't do that right now.  You have to create a new data source.18:02
crobertsrhHmm18:02
crobertsrhThey aren't particularly hard to create (not many steps), but we could probably add it.18:03
tmckayI would even lift any restriction that you can't edit if it's currently referenced.  Because any job in the Running state already has pulled the info from the objects.18:03
crobertsrhI suppose if there were several binaries referenced and you needed to tweak one, that might be ugly to totally re-create18:03
tmckayno, not particularly hard.  But if you can relaunch the job execution, which already references it, and just tweak the path, it's super easy18:04
crobertsrhWorth an add to the Liberty list and see where it shakes out priority-wise18:04
tmckaycrobertsrh, the other thing is to fix up relaunch.  In some cases, values don't show up on the relaunch tab.  You end up having to re-enter them.  I forget which, I'll have to file a bug.18:05
crobertsrhOh, yeah, that's probably a bug18:05
*** jamielennox|away is now known as jamielennox18:05
crobertsrhProbably values that were added after the relaunch was first put in18:06
tmckayI was looking on Thurs for rough edges while I was running Java jobs, and these things all happened to me :)18:06
crobertsrhawesome18:06
tmckaycrobertsrh, ack18:06
crobertsrhIf I were really clever, I'd find a way to not have to update the relaunch bits whenever a new item was added.18:06
tmckaycrobertsrh, other thought was validating swift paths when you create the data source.  "Hey, that doesn't exist.  I'll make it anyway, but ..."18:07
tmckayso you have a clue before you run the thing18:07
crobertsrhI like that18:07
crobertsrhAlso, making sure that your output DS is clean before running and barfing because it wasn't18:07
tmckaycrobertsrh, ^^ ack on the clever.  Maybe something is missing from the API, maybe it can be part of the V2 discussion.  Is there an op you need?  Is there something that should be added to a job execution object?18:08
tmckaycrobertsrh, agreed on the output.18:08
crobertsrhNot sure what exactly we'd need.  The job_ex object really just crams stuff into a few fields18:08
tmckayand, if you do any of this stuff with a transient cluster, woe is you18:08
crobertsrhI might just be able to do better inspection of the job_ex object and params and configs, etc and add fields with their defaults, assuming that I can figure out what sort of field they need to be18:09
crobertsrhSo, more generally, we want better upfront validation of everything that we can validate as soon as it can be validated.18:10
tmckaycrobertsrh, actually, if you read egafford's spec on job interface mapping https://blueprints.launchpad.net/sahara/+spec/unified-job-interface-map that might spark ideas.  If we get that implemented, and we know how configs/args/params map to the job, maybe it will be a guide for the UI on relaunch18:12
tmckayI validate your statement18:12
crobertsrhYeah, that is probably a good starting point18:12
tmckaycrobertsrh, alright, thanks, I'll make blueprints for data source and job binary editing.18:14
crobertsrhSounds good18:14
*** tosky has quit IRC18:14
crobertsrhLet me know when you're done, I'll add the corresponding bps for horizon.18:14
tmckayok18:14
*** tellesnobrega has quit IRC18:25
*** tellesnobrega has joined #openstack-sahara18:26
*** tellesnobrega_ has joined #openstack-sahara18:27
*** tellesnobrega_ has quit IRC18:27
*** tellesnobrega has quit IRC18:29
*** tellesnobrega has joined #openstack-sahara18:29
tellesnobregatmckay, it's almost ready for not being a wip https://review.openstack.org/#/c/168302/18:33
tellesnobregacrobertsrh, sahara interface's code is integrated with horizon?18:34
crobertsrhyes18:34
crobertsrhunder openstack_dashboard/dashboards/project/data_processing18:34
openstackgerritAndrew Lazarev proposed openstack/sahara: Implemented support of placeholders in datasource URLs  https://review.openstack.org/15890918:34
*** sreshetn1 has joined #openstack-sahara18:36
tmckaytellesnobrega, thanks, I'll check it out18:36
tellesnobregacrobertsrh18:36
tellesnobregatmckay, i have to change the commit message18:36
tellesnobregai wrote about UI, but it needs to be a separated patch18:37
tellesnobregathanks18:37
*** pino|work has quit IRC18:43
*** chen12 has quit IRC19:08
*** sgotliv has joined #openstack-sahara19:21
*** sreshetn1 has quit IRC19:40
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/17349019:53
*** sreshetn1 has joined #openstack-sahara19:57
*** Nikolay_St has joined #openstack-sahara20:29
*** hdd has joined #openstack-sahara20:53
*** tmckay has left #openstack-sahara20:58
*** sreshetn1 has quit IRC21:03
*** crobertsrh is now known as _crobertsrh21:04
*** hdd has quit IRC21:04
openstackgerritlu huichun proposed openstack/sahara: Adding config hints for CDH plugin  https://review.openstack.org/16946621:07
*** sreshetn1 has joined #openstack-sahara21:07
openstackgerritlu huichun proposed openstack/sahara: Adding config hints for CDH plugin  https://review.openstack.org/16946621:08
openstackgerritEmilien Macchi proposed stackforge/puppet-sahara: Synchronize LICENSE file with OpenStack projects  https://review.openstack.org/17353021:14
*** sgotliv has quit IRC21:31
*** sreshetn1 has quit IRC21:44
*** tnovacik has quit IRC21:57
*** witlessb has quit IRC22:29
*** chlong has joined #openstack-sahara23:10
*** chlong has quit IRC23:43
*** chlong has joined #openstack-sahara23:45

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!