Monday, 2015-03-09

*** hdd_ has quit IRC00:05
*** witlessb has quit IRC00:26
*** hdd_ has joined #openstack-sahara02:06
*** macjack has quit IRC02:23
*** Krast has joined #openstack-sahara02:32
*** coolsvap has joined #openstack-sahara02:34
*** Poornima has joined #openstack-sahara02:36
openstackgerritMichael McCune proposed openstack/sahara: Adding barbican client and keymgr module  https://review.openstack.org/16219802:46
*** Longgeek has joined #openstack-sahara02:55
*** chandankumar has joined #openstack-sahara03:46
*** chandankumar has quit IRC04:00
*** chandankumar has joined #openstack-sahara04:00
*** Poornima has quit IRC04:07
*** weiting has joined #openstack-sahara04:56
*** weiting has quit IRC04:57
*** sgotliv has quit IRC05:11
*** hdd_ has quit IRC05:13
*** hdd_ has joined #openstack-sahara05:31
*** Poornima has joined #openstack-sahara05:32
*** chandankumar has quit IRC05:33
*** chandankumar has joined #openstack-sahara06:02
*** hdd_ has quit IRC06:07
*** Poornima has quit IRC06:18
*** Poornima has joined #openstack-sahara06:29
*** tnovacik has joined #openstack-sahara06:34
*** Poornima has quit IRC06:35
*** Poornima has joined #openstack-sahara06:37
*** sgotliv has joined #openstack-sahara06:39
*** sgotliv has quit IRC06:44
*** tnovacik has quit IRC06:46
*** sgotliv has joined #openstack-sahara06:58
*** Networkn3rd has quit IRC07:06
*** Networkn3rd has joined #openstack-sahara07:09
*** Networkn3rd has quit IRC07:14
*** Networkn3rd has joined #openstack-sahara07:15
*** macjack has joined #openstack-sahara07:30
*** macjack has quit IRC07:36
openstackgerritSergey Reshetnyak proposed openstack/sahara: [DO NOT MERGE] DEBUG  https://review.openstack.org/16255407:50
*** chlong has quit IRC08:07
openstackgerritSergey Reshetnyak proposed openstack/sahara: [DO NOT MERGE] DEBUG  https://review.openstack.org/16255408:10
*** chandankumar has quit IRC08:11
*** tnovacik has joined #openstack-sahara08:15
*** chandankumar has joined #openstack-sahara08:20
*** witlessb has joined #openstack-sahara08:40
*** tnovacik has quit IRC08:45
*** tnovacik has joined #openstack-sahara08:49
openstackgerritSergey Reshetnyak proposed openstack/sahara: Fix tempest tests for Sahara  https://review.openstack.org/16256808:50
*** macjack has joined #openstack-sahara08:54
*** hogepodge has quit IRC09:04
*** hogepodge has joined #openstack-sahara09:06
openstackgerritSergey Reshetnyak proposed openstack/sahara: Fix tempest tests for Sahara  https://review.openstack.org/16256809:24
*** macjack has quit IRC09:31
*** macjack has joined #openstack-sahara09:37
openstackgerritPino Toscano proposed openstack/sahara-image-elements: spark: small syntax hiccup in the vars check  https://review.openstack.org/16258309:48
*** coolsvap has quit IRC10:17
openstackgerritSergey Reshetnyak proposed openstack/sahara: Fix tempest tests for Sahara  https://review.openstack.org/16256810:25
*** Nikolay_St has quit IRC10:43
*** Nikolay_St has joined #openstack-sahara10:44
*** serg_ has joined #openstack-sahara10:45
*** serg_ has quit IRC10:46
*** sreshetn1ak has joined #openstack-sahara10:49
*** macjack has quit IRC10:49
*** sreshetn1ak has quit IRC11:00
*** macjack has joined #openstack-sahara11:02
*** macjack has quit IRC11:03
*** chlong has joined #openstack-sahara11:03
*** macjack has joined #openstack-sahara11:03
*** Poornima has quit IRC11:06
*** macjack has quit IRC11:11
*** macjack has joined #openstack-sahara11:13
*** macjack has quit IRC11:16
*** macjack has joined #openstack-sahara11:16
*** tnovacik has quit IRC11:37
openstackgerritSergey Reshetnyak proposed stackforge/sahara-ci-config: Fix tempest client tests  https://review.openstack.org/16261411:58
openstackgerritSergey Reshetnyak proposed stackforge/sahara-ci-config: Fix tempest client tests  https://review.openstack.org/16261412:00
*** sgotliv has quit IRC12:17
*** sgotliv has joined #openstack-sahara12:32
*** tnovacik has joined #openstack-sahara12:34
*** tnovacik has quit IRC12:47
*** albertoffb has joined #openstack-sahara12:57
*** chlong has quit IRC13:04
openstackgerritMichael McCune proposed openstack/sahara: Adding barbican client and keymgr module  https://review.openstack.org/16219813:08
*** egafford has joined #openstack-sahara13:12
*** chlong has joined #openstack-sahara13:17
*** chandankumar has quit IRC13:43
*** sgotliv_ has joined #openstack-sahara13:53
*** sgotliv has quit IRC13:53
*** Nikolay_St has quit IRC13:55
*** Nikolay_St has joined #openstack-sahara13:56
*** _mattf is now known as mattf14:05
*** tnovacik has joined #openstack-sahara14:22
*** Networkn3rd has quit IRC14:35
*** Nikolay_St has quit IRC14:49
*** tosky has joined #openstack-sahara15:00
*** tmckay has joined #openstack-sahara15:14
openstackgerritlu huichun proposed openstack/sahara: Add a common HBase lib in hdfs on cluster start  https://review.openstack.org/16265715:27
*** sgotliv has joined #openstack-sahara15:58
*** sgotliv_ has quit IRC15:58
openstackgerritAdrien Vergé proposed openstack/sahara: HDP plugin: Fix Bash error when starting Hue  https://review.openstack.org/16266716:01
openstackgerritAdrien Vergé proposed openstack/sahara: HDP plugin: Fix Beeswax error when starting Hue  https://review.openstack.org/16266816:02
*** hdd_ has joined #openstack-sahara16:06
tellesnobregahey guys, i found something that might be a bug16:09
tellesnobregai ran some jobs in a hadoop cluster and deleted the cluster when it was finished16:09
tellesnobregasahara job-list shows the jobs with cluster_id = None16:09
elmikoi thought we had a bug similar to this in launchpad /me checks16:10
tellesnobregathe problem is that horizon tries to get cluster_name from the cluster where cluster is None and it fails to load the job_execution window16:10
elmikoit certainly sounds like a bug16:11
elmikotellesnobrega: i'd say write it up on launchpad, add your steps to reproduce, etc...16:12
tellesnobregai removed the jobs via cli and horizon is back16:12
tellesnobregaelmiko, will do now16:12
toskytellesnobrega: there is a patch for that16:18
toskytellesnobrega: wait a minute please16:19
*** chandankumar has joined #openstack-sahara16:19
elmikotosky: is it under sahara or horizon, i looked but didn't see anything16:20
toskytellesnobrega, elmiko: https://review.openstack.org/#/c/125927/16:21
elmikolol, i *knew* this sounded familiar!16:22
toskytellesnobrega: try the above patch, job execution should  work again16:22
elmikothat patch has been under review for like 6 months now... ಠ_ಠ16:22
*** hdd_ has quit IRC16:22
tellesnobregatosky, thanks16:24
tellesnobregaelmiko, thanks as well16:24
tellesnobregai set the bug i reported to invalid16:26
toskytellesnobrega: or duplicate of one (the closest one) of the bugs referenced in the review16:27
toskytellesnobrega: better, closed, and marked as duplicate (which are two different actions in launchpad, compared to bugzilla)16:27
elmikoyea, duplicate16:28
tellesnobregai cant mark as duplicate16:28
toskytellesnobrega: you can, see on the top-right area of the bug16:28
elmikoit should be a link on the right hand side16:28
toskyiirc16:28
tellesnobregasorry, found it16:28
*** Longgeek has quit IRC16:29
tellesnobregadone16:31
tellesnobregathanks16:32
tellesnobregawhy is it taking so long for this to be merged?16:32
elmikowho knows16:33
tellesnobregalol16:34
elmikowe've been trying to get it merged, but something always comes up16:34
*** akuznetsov has joined #openstack-sahara16:35
*** bandarji has joined #openstack-sahara16:48
*** mattf is now known as _mattf16:49
*** akuznetsov has quit IRC16:50
*** Krast has quit IRC16:55
*** Krast has joined #openstack-sahara16:56
*** Networkn3rd has joined #openstack-sahara17:23
*** sgotliv has quit IRC17:28
openstackgerritMerged openstack/sahara-image-elements: Switch from qemu to qemu-img on Fedora  https://review.openstack.org/16215617:30
*** chandankumar has quit IRC17:32
*** Nikolay_St has joined #openstack-sahara17:32
*** hdd_ has joined #openstack-sahara17:39
*** chandankumar has joined #openstack-sahara17:42
*** chandankumar has quit IRC17:56
*** chandankumar has joined #openstack-sahara18:02
openstackgerritSergey Reshetnyak proposed stackforge/sahara-ci-config: Fix tempest client tests  https://review.openstack.org/16261418:05
*** chlong has quit IRC18:05
openstackgerritMerged stackforge/sahara-ci-config: Fix tempest client tests  https://review.openstack.org/16261418:33
*** sgotliv has joined #openstack-sahara18:38
*** hdd_ has quit IRC18:47
*** serg1 has joined #openstack-sahara18:52
*** serg1 has quit IRC18:54
*** serg1 has joined #openstack-sahara18:54
*** syncroswitch has joined #openstack-sahara19:01
*** serg1 has quit IRC19:07
*** Longgeek has joined #openstack-sahara19:08
*** tosky has quit IRC19:08
*** sreshetn1 has joined #openstack-sahara19:09
*** hdd_ has joined #openstack-sahara19:09
openstackgerritMerged openstack/sahara: Updated from global requirements  https://review.openstack.org/16139719:11
*** Longgeek has quit IRC19:12
*** sgotliv has quit IRC19:13
*** sgotliv has joined #openstack-sahara19:16
crobertsrhsreshnetyak:  Are you around?19:20
*** chandankumar has quit IRC19:28
*** chandankumar has joined #openstack-sahara19:33
tmckaycrobertsrh, elmiko, btw, that discussion of conductor vs db api level -- has to be the conductor.  There is node_group_template/cluster_template magic happening in conductor/manager.19:43
tmckaySo, I'll have to find a way to fix the unwanted config options.19:44
crobertsrhah, magic wins out19:44
elmikoahh, too bad19:44
tmckaythe only other option is refactor the manager stuff, so the template magic is separate and doesn't pull in the extra configs.  Maybe I should look at that.19:45
elmikothat sounds like more work, but probably very worthwhile in the interest of greater modularity19:45
tmckayrunning out of time, though.19:46
tmckayMaybe phase two.19:46
crobertsrhSeparate template magic level :)19:46
crobertsrhMaybe just a "magic" level...that way we can perform other non-template miracles as well19:46
tmckaythe way we do config options means that any module you happen to touch pastes all its config stuff in19:47
elmikothere might be some way to fake-out oslo_config and have it avoid that stuff?19:47
tmckayyeah, I need a way to filter only the stuff that I want.19:47
tmckaymaybe there is a CONF.unregister, where I can wipe out sections and/or configs19:48
elmikoyea19:50
elmikolike you could clear the CONF or something, tell it to fake out or whatever19:50
tmckayelmiko, in playing with oslo_config, have you happened to see way to collect extra options?20:08
tmckayargparse has a way, and oslo is wrapped around argparse20:08
elmikotmckay: sorry no, i haven't really delved that deep20:08
tmckayI'd like to collect "everything else" and put it in a dictionary for substitution so that it's not restricted to explicit fields20:09
tmckayalright20:09
elmikotmckay: like, are you thinking just collecting **kwargs at the end of the stated args?20:10
tmckayyeah20:10
elmikothat could work20:10
*** chandankumar has quit IRC20:13
tmckayelmiko, hmm, that works20:17
tmckaysahara-templates --config-file etc/sahara/sahara.conf update -t REST_scripts/ one=two three=four20:18
tmckayelmiko, you can funnel all the additional args into an extra option20:18
elmikotmckay: convenient =)20:19
tmckayelmiko, so here you would do stuff like tenant_id=asflllfsdf floating_ip_pool=asfasf20:19
tmckayelmiko, and the template json files will have fields with values like "%(tenant_id)s" to match against the dict20:19
tmckayelmiko, what do you think? Good enough?20:20
tmckayI'm sensitive to the clock20:20
tmckayThis way, the subs are unbounded, you can do whatever you want with your templates20:20
tmckayAnd you can see the possible subs by cat'ing the template files20:20
elmikoaside from my personal preference for .format style interpolation, it seems like a quick way to solve the issue20:21
tmckaywill .format do names?  I forget20:21
elmikoyea, it allows the user to gather all the ids and everything, which is nice20:21
elmikoyea, '{name}'.format(name='spam')20:22
elmikobut, use whatever you are comfortable with20:22
*** Nikolay_St has quit IRC20:38
sreshetn1crobertsrh: i'm here20:38
crobertsrhah, great....20:38
*** Nikolay_St has joined #openstack-sahara20:39
crobertsrhremember the change in horizon to go from data_processing to data-processing?20:39
crobertsrhI believe it leads to none of the Sahara panels showing-up in horizon.20:39
crobertsrhhttps://bugs.launchpad.net/horizon/+bug/142998720:40
openstackLaunchpad bug 1429987 in OpenStack Dashboard (Horizon) "[data processing] After update to use "data-processing", no sahara panels show up" [Undecided,In progress] - Assigned to Chad Roberts (croberts)20:40
crobertsrhI didn't think it was going to be much of a problem, but I submitted a quick change for the fix....20:40
crobertsrhhttps://review.openstack.org/#/c/162736/20:40
sreshetn1hmm, it works on my desktop20:40
crobertsrhOh...maybe I'm fixing a problem that only I have20:41
crobertsrhit would explain why all the tests fail on my change :)20:41
crobertsrhI will try a clean env.20:41
sreshetn1your openstack contains data-processing endpoint?20:45
crobertsrhYeah20:46
crobertsrhDoes your stack still contain the data_processing endpoint?20:49
crobertsrhsreshetn1:  ^^^20:49
sreshetn1yes20:49
crobertsrhthat's probably why it still works20:50
*** Nikolay_St has quit IRC20:53
*** tmckay has quit IRC20:53
*** Nikolay_St has joined #openstack-sahara20:54
sreshetn1i removed old data_processing service and sahara panels not working :(21:00
crobertsrhI thought that my patch would take care of it....and it does....except all the tests fail :(21:01
crobertsrh^^ bit of a problem :)21:02
crobertsrhvery strange.  When I revert my patch, the tests succeed again.  There must be some magic somewhere that points to data_processing21:06
crobertsrhIt looks like somehow, all of the requests are getting redirected to login21:11
crobertsrh^^^ for the tests failing, that is.21:11
crobertsrhAh...figured it out :)21:14
sreshetn1renaming urls in tests resolves problem with tests21:16
crobertsrhsreshetn1:  Nevermind.  I think I got my patch sorted out.  There was some other details long-lost in the test data that I had totally forgot about.  Updated patch should bring things back to life.21:16
crobertsrhtake a look at https://review.openstack.org/#/c/162736/  and give a review please.21:19
sreshetn1it works :) thanks for your work21:23
crobertsrhNo problem.21:24
crobertsrhI should have caught it before I +1'ed the original patch :)21:24
crobertsrhOh, whew....I didn't +1 it!21:24
crobertsrhI'm clear :)21:24
sreshetn1:)21:25
syncroswitchis the change for https://bugs.launchpad.net/horizon/+bug/1429987 also causing "Error: Invalid service catalog service: data-processing" error that I've been getting all morning21:26
openstackLaunchpad bug 1429987 in OpenStack Dashboard (Horizon) "[data processing] After update to use "data-processing", no sahara panels show up" [Undecided,In progress] - Assigned to Chad Roberts (croberts)21:26
crobertsrhsyncroswitch:  most likely not...it is related though.21:27
crobertsrhThe fix for that is a) restack (if you're doing devstack) or  b)  delete your old service/endpoint in keystone and re-create it as data-processing instead of data_processing.21:28
crobertsrhbut caution, you will experience bug 1429987 until it is merged21:29
openstackbug 1429987 in OpenStack Dashboard (Horizon) "[data processing] After update to use "data-processing", no sahara panels show up" [Undecided,In progress] https://launchpad.net/bugs/1429987 - Assigned to Chad Roberts (croberts)21:29
*** sreshetn1 has quit IRC21:31
*** crobertsrh is now known as _crobertsrh21:35
*** Networkn3rd has quit IRC21:36
*** chlong has joined #openstack-sahara21:45
*** egafford has quit IRC21:48
*** akuznetsov has joined #openstack-sahara21:51
*** chlong has quit IRC21:57
*** chlong has joined #openstack-sahara21:57
*** chlong has quit IRC22:04
*** tmckay has joined #openstack-sahara22:07
*** openstack has joined #openstack-sahara22:24
*** sreshetn1 has joined #openstack-sahara22:27
*** sreshetn1 has quit IRC22:32
*** openstack has joined #openstack-sahara23:24
*** chlong has joined #openstack-sahara23:43
*** akuznetsov has quit IRC23:48
*** witlessb has quit IRC23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!