Tuesday, 2014-08-12

*** witlessb has quit IRC00:07
*** Networkn3rd has joined #openstack-sahara00:52
*** sudarshan has joined #openstack-sahara00:57
sudarshanHey - I'm looking to use sahara with a keystone templated catalog. How can I register the sahara endpoint? doing something like catalog.Region.sahara.publicURL etc doesn't seem to work01:05
*** xianghuihui has quit IRC01:21
*** xianghui has joined #openstack-sahara01:26
*** xianghui has quit IRC01:34
*** xianghuihui has joined #openstack-sahara01:34
*** witlessb has joined #openstack-sahara01:56
*** witlessb has quit IRC02:01
*** bradd1 has joined #openstack-sahara02:01
*** alazarev has quit IRC02:14
*** alazarev has joined #openstack-sahara02:15
*** Networkn3rd has quit IRC03:28
*** Networkn3rd has joined #openstack-sahara03:29
*** Networkn3rd has quit IRC03:55
*** ViswaV has joined #openstack-sahara04:05
*** ViswaV has joined #openstack-sahara04:14
*** ViswaV has joined #openstack-sahara04:15
*** ViswaV has quit IRC04:15
*** ViswaV has joined #openstack-sahara04:21
*** ViswaV has quit IRC04:25
*** ViswaV has joined #openstack-sahara04:26
*** Networkn3rd has joined #openstack-sahara04:31
*** ViswaV_ has joined #openstack-sahara04:53
*** ViswaV__ has joined #openstack-sahara04:54
*** ViswaV_ has quit IRC04:55
*** ViswaV_ has joined #openstack-sahara04:55
*** ViswaV has quit IRC04:56
*** ViswaV has joined #openstack-sahara04:56
*** ViswaV has quit IRC04:58
*** Networkn3rd has quit IRC04:58
*** ViswaV__ has quit IRC04:58
*** ViswaV has joined #openstack-sahara04:59
*** ViswaV_ has quit IRC04:59
*** mattf has quit IRC05:07
*** mattf has joined #openstack-sahara05:07
*** Longgeek has joined #openstack-sahara05:07
*** ViswaV has quit IRC05:35
*** ViswaV has joined #openstack-sahara05:35
*** k4n0 has joined #openstack-sahara05:37
*** akuznetsov has quit IRC05:38
*** ViswaV_ has joined #openstack-sahara05:48
*** ViswaV has quit IRC05:48
*** akuznetsov has joined #openstack-sahara05:54
*** ViswaV_ has quit IRC05:56
*** ViswaV has joined #openstack-sahara05:57
*** mattf has quit IRC06:02
*** mattf has joined #openstack-sahara06:05
openstackgerritOpenStack Proposal Bot proposed a change to openstack/sahara: Imported Translations from Transifex  https://review.openstack.org/11344506:10
*** Longgeek has quit IRC06:19
*** Longgeek has joined #openstack-sahara06:21
*** tnovacik has joined #openstack-sahara07:06
*** robsparker has quit IRC07:08
*** sballe has joined #openstack-sahara07:27
openstackgerritA change was merged to openstack/sahara: Fixed DecommissionError bug  https://review.openstack.org/11320007:53
*** Krast has joined #openstack-sahara08:06
*** witlessb has joined #openstack-sahara08:17
*** yiconglu has joined #openstack-sahara08:23
openstackgerritA change was merged to openstack/sahara: Imported Translations from Transifex  https://review.openstack.org/11344508:25
openstackgerritVitaly Gridnev proposed a change to openstack/sahara: Add notifications to Sahara  https://review.openstack.org/10898208:30
*** DenisEgorenko has joined #openstack-sahara08:32
openstackgerritAndrey Pavlov proposed a change to openstack/sahara: Fixed Exception failures caused by i18n  https://review.openstack.org/11319608:34
*** Krast has quit IRC08:40
*** Krast has joined #openstack-sahara08:40
*** yiconglu has quit IRC09:39
openstackgerritA change was merged to stackforge/sahara-ci-config: Refactoring of CI scripts  https://review.openstack.org/11121609:43
SergeyLukjanov_elmiko, IMO we should just make a CR to change existing spec09:43
*** tosky has joined #openstack-sahara09:44
*** zhiyan has quit IRC09:47
*** zhiyan has joined #openstack-sahara09:52
*** zhiyan has quit IRC09:57
*** zhiyan has joined #openstack-sahara09:59
*** mst89 has joined #openstack-sahara10:03
*** vrovachev has joined #openstack-sahara10:04
*** vrovachev has quit IRC10:06
*** mikehn has joined #openstack-sahara10:29
*** sballe has quit IRC10:46
*** Krast has quit IRC10:50
*** RockKuo_Home has joined #openstack-sahara10:51
*** tnovacik_ has joined #openstack-sahara11:02
*** tnovacik has quit IRC11:02
*** Longgeek has quit IRC11:10
*** Longgeek has joined #openstack-sahara11:10
openstackgerritVitaly Gridnev proposed a change to openstack/sahara: Add notifications to Sahara  https://review.openstack.org/10898211:13
*** Longgeek has quit IRC11:14
*** Longgeek has joined #openstack-sahara11:34
openstackgerritVitaly Gridnev proposed a change to openstack/sahara: Add notifications to Sahara  https://review.openstack.org/10898211:40
*** akuznetsov has quit IRC12:09
openstackgerritVitaly Gridnev proposed a change to openstack/sahara: Add docs with Sahara notifications configuration  https://review.openstack.org/11323412:12
*** akuznetsov has joined #openstack-sahara12:22
*** miqui has joined #openstack-sahara12:44
*** Networkn3rd has joined #openstack-sahara12:45
*** k4n0 has quit IRC12:53
openstackgerritSergey Reshetnyak proposed a change to openstack/sahara: Unit tests for CDH plugin  https://review.openstack.org/11351313:00
*** _elmiko is now known as elmiko13:09
elmikoSergeyLukjanov: thanks13:09
openstackgerritAndrey Pavlov proposed a change to openstack/sahara: Add translation support to plugin modules  https://review.openstack.org/10771813:18
*** mst89 has quit IRC13:21
*** mst89 has joined #openstack-sahara13:24
elmikoanyone know if we released 2014.1.2 yesterday?13:25
SergeyLukjanovelmiko, I'll do it today I think13:27
elmikoSergeyLukjanov: cool, thanks13:27
openstackgerritAndrey Pavlov proposed a change to openstack/sahara: Fixed Exception failures caused by i18n  https://review.openstack.org/11319613:29
*** tmckay has joined #openstack-sahara13:38
*** tmckay has joined #openstack-sahara13:42
*** bradd1 has quit IRC14:05
*** bradd1 has joined #openstack-sahara14:06
*** tellesnobrega has quit IRC14:09
*** tellesnobrega has joined #openstack-sahara14:14
*** mst89 has quit IRC14:34
*** alazarev has joined #openstack-sahara14:35
*** tnovacik_ has quit IRC14:39
*** tnovacik_ has joined #openstack-sahara14:48
dmitrymetmckay, aignatov: could you please take a look on https://ask.openstack.org/en/question/44583/sahara-java-job/15:12
*** skolekonov has quit IRC15:26
*** tnovacik_ is now known as tnovacik15:28
*** alazarev has quit IRC15:28
*** Networkn3rd has quit IRC15:30
*** tosky has quit IRC15:31
tnovaciktmckay, Hi, do you have a sec?15:33
openstackgerritDenis Egorenko proposed a change to stackforge/sahara-ci-config: Fixing wrong handling for 'HEAT_JOB'  https://review.openstack.org/11356315:48
sudarshanHey - I'm looking to use sahara with a keystone templated catalog. How can I register the sahara endpoint in the static catalog file? doing something like catalog.Region.sahara.publicURL etc doesn't seem to work15:58
dmitrymesudarshan: what do you mean by “templated catalog”?16:02
sudarshanhttp://docs.openstack.org/developer/keystone/configuration.html#file-based-service-catalog-templated-catalog16:02
sudarshanSo in keystone you can register endpoints like this: https://github.com/openstack-dev/devstack/blob/master/files/default_catalog.templates16:02
*** alazarev has joined #openstack-sahara16:08
dmitrymesudarshan: use ‘data_processing’ instead of ‘sahara’, i.e. catalog.Region.data_processing.publicURL16:11
dmitrymesahara-dashboard expects ‘data_processing’ endpoint to be registered16:12
sudarshanI'm fairly sure I tried that as well, but I'll try again.16:13
sudarshanI'm not actually looking to use sahara-dashboard at the moment, I'm just using the cli interface of python-saharaclient16:13
dmitrymedid you set up all three urls: publicURL, adminURL and internalURL?16:13
dmitrymepython-saharaclient also expects data_processing endpoint: https://github.com/openstack/python-saharaclient/blob/6f29bf23f6de18da1473fa224579daec0dd602dd/saharaclient/api/client.py#L3516:15
sudarshanYes, I see that, and I had set everything up correctly16:18
sudarshanusing the --debug option on python saharaclient shows that the endpoint it's getting back from keystone is "data-processing", even though I registered it as "data_processing" in the keystone conf file16:18
sudarshanso it looks like underscores in the keystone catalog get turned into dashes when sent out as a response16:22
tmckaytnovacik, hi, I was on a call16:26
*** mattf is now known as _mattf16:27
tnovaciktmckay, i am creating some sahara selenium tests, tosky told me that there exist some basic examples, could you point me to them? Are those examples going to be merged into horizon repository any time soon?16:28
tnovaciktmckay, i am talking about job binaries examples etc...16:30
tmckaytnovacik, I have some EDP job files that Sahara uses for ci tests, and that users can use to launch jobs through the UI.  They are in two places, currently being moved to etc/edp-examples in the Sahara repo (under review)16:30
tmckayFirst place is sahara-extra/edp-examples currently16:31
tnovacikokay, thx, any plan on moving them into horizon?16:31
tmckaysecond place is sahara/tests/integration/tests/resources I believe16:31
dmitrymesudarshan: re underscores turned into dashes: you can check that by running ‘keystone catalog’16:31
tmckaytnovacik, no, they'll stay in sahara.  Not really part of horizon per se.16:32
tmckaytnovacik, https://review.openstack.org/#/c/112614/16:32
tmckayIf you check that out you can find them in one place16:32
tmckaytnovacik, and I'm about to add a dependent CR to include a spark example16:33
*** clayb has joined #openstack-sahara16:33
tmckaytnovaciki, of those, the edp-java wordcount example has the biggest README :)16:33
tmckaytnovacik,   ^^ over time I hope to add more detail to the other examples as well16:33
sudarshan@dmitryme - confirmed. "Service: data-processing", even after using "catalog.REGION.data_processing.publicURL"16:33
dmitrymesudarshan: you can override service type expected by sahara client by suppling --service-type16:34
dmitrymesahara --service-type data-processing …16:34
sudarshanRight, but then, as you mentioned, the dashboard won't work, because it is looking for sahara to be registered as data_processing16:34
tnovaciktmckay, in case i need one of those examples during test execution, i am allowed to push it to horizon?(say 1 or 2 examples?)16:35
tnovacik*am i16:35
dmitrymeare you using sahara-dashboard project?16:35
sudarshanyes16:35
tmckaytnovacik, I don't know.  _crobertsrh?  ^^  Where would it be pushed?16:36
tmckaytnovacik, I have no problem with it, but I don't know much about the horizon structure16:36
_crobertsrhoh, is sahara-dashboard still using the wrong service-type?16:37
sudarshan"also, running sahara --service-type data-processing" still causes "ERROR: Could not find sahara endpoint in catalog", even though the service is reported as data-processing. My guess is that sahara client also converts dashes to underscores16:37
tnovaciktmckay, okay, thanks i ll try to bother _crobertsrh with the rest :o), helpful as always =-)16:37
dmitrymesudarshan: you can override expected service type in local_settings.py by suppling SAHARA_SERVICE16:37
_crobertsrhThe actual dashboard has been merged into horizon now, that should work.  Or am I missing something?16:38
tmckaytnovacik, no problem.  Let me know if you have trouble with the tests16:38
sudarshanthings do work if i enter a --bypass-url parameter16:38
dmitryme_crobertsrh: I am speaking about sahara-dashboard project, not code merged in Horizon16:38
dmitryme_crobertsrh: btw is data_processing wrong?16:38
_crobertsrhdata_processing is correct.16:39
sudarshan@_crobertsrh - the issue is that keystone endpoints, when configured using a static file, seems to convert type "data_processing" to "data-processing" which makes saharaclient unhappy16:39
sudarshanI'd like to have a solution for this that doesn't involve passing in extra command line parameters every time I call sahara16:40
_crobertsrhsudarshan:  so, you're using the command line interface, not the Horizon dashboard?16:40
sudarshanI'm using both. For now, just testing with the command-line interface, but I'd like both to be operating correctly16:41
_crobertsrhOk, I see16:41
dmitrymeguys, I have to leave, will look into what you’ve found later today or tomorrow16:41
_crobertsrhTo me, it seems like a bug that data_processing gets turned into data-processing (a keystone bug maybe?)16:42
sudarshanPreviously when I was registering endpoints using the keystone api, things worked properly; I think that when keystone parses the catalog file for the first time it converts underscores to dashes16:42
_crobertsrhI wonder if that is a bug or a feature (by their design)16:43
_crobertsrhI'm looking into that now16:43
sudarshanI have a strong feeling its a "feature" of oslo.config, where it converts dashes to underscores16:43
_crobertsrhAh.  I believe that16:44
_crobertsrhI'm in another meeting at the moment.  I'll think more about this when that is done (hopefully soon)16:44
sudarshanAllright, no problem.16:44
*** akuznetsov has quit IRC16:58
openstackgerritA change was merged to stackforge/sahara-ci-config: Fixing wrong handling for 'HEAT_JOB'  https://review.openstack.org/11356316:59
sudarshan@_crobertsrh - Found it. It's not oslo after all, its an intended part of keystone: https://github.com/openstack/keystone/blob/master/keystone/catalog/backends/templated.py#L4717:04
sudarshanthis just causes a bit of a problem for services like sahara that are expecting to be registered with underscores\17:05
openstackgerritMichael McCune proposed a change to openstack/sahara-specs: Updating EDP Swift trust authentication spec  https://review.openstack.org/11359117:21
*** elmiko is now known as _elmiko17:22
*** Networkn3rd has joined #openstack-sahara17:22
*** Networkn3rd has quit IRC17:22
*** Networkn3rd has joined #openstack-sahara17:50
*** ViswaV has joined #openstack-sahara18:01
*** ViswaV_ has joined #openstack-sahara18:02
*** ViswaV has quit IRC18:02
_crobertsrhsudarshan:  Ok, glad you found it....now...what can we do about it is the question18:14
openstackgerritArtem Osadchiy proposed a change to openstack/sahara: MapR plugin implementation  https://review.openstack.org/11339118:20
*** alazarev has quit IRC18:22
*** ViswaV_ has quit IRC18:26
*** Longgeek has quit IRC18:32
sudarshan@crobertsrh - I think we have a couple of options. We could modify sahara to look for data-processing, but that would require changes in the dashboard and other client apps as well. Or we could see what happens if we remove that line in keystone and allow underscored names18:36
sudarshanWhat do you think?18:36
_crobertsrhDo you mean propose removing that line from the keystone code itself in a patch?18:38
_crobertsrhThat seems like the right thing to do18:38
_crobertsrhIt is even commented that it's there just for object-store, which is strange18:38
sudarshanyeah. okay, I think I will change it locally for myself, and let you guys figure out how you want to fix it going forward. Would you like me to submit a bug report?18:39
*** ViswaV has joined #openstack-sahara18:47
*** ViswaV_ has joined #openstack-sahara18:48
*** ViswaV has quit IRC18:48
*** alazarev has joined #openstack-sahara18:50
_crobertsrhYeah, a bug report might be a good idea, thanks sudarshan :)18:52
*** witlessb has quit IRC18:54
*** _mattf is now known as mattf19:02
*** mattf has quit IRC19:03
*** mattf has joined #openstack-sahara19:03
*** ViswaV_ has quit IRC19:22
*** julienvey has joined #openstack-sahara19:52
*** alazarev has quit IRC20:01
*** Networkn3rd has quit IRC20:02
*** mattf is now known as _mattf20:05
*** tnovacik has quit IRC20:08
*** bradd11 has joined #openstack-sahara20:09
*** bradd1 has quit IRC20:10
*** bradd11 has quit IRC20:14
*** bradd1 has joined #openstack-sahara20:20
*** _crobertsrh has quit IRC20:27
*** crobertsrh has joined #openstack-sahara20:28
*** julienvey has quit IRC20:30
*** ViswaV has joined #openstack-sahara20:30
*** witlessb has joined #openstack-sahara20:32
*** tnovacik has joined #openstack-sahara20:54
*** alazarev has joined #openstack-sahara20:55
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Improved error handling for provisioning operations  https://review.openstack.org/10439521:00
*** miqui has quit IRC21:02
*** tnovacik has quit IRC21:12
*** tmckay has quit IRC21:15
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Added ability to create security group automatically  https://review.openstack.org/10939421:42
*** julienvey has joined #openstack-sahara21:54
*** alazarev has quit IRC21:55
*** alazarev has joined #openstack-sahara21:58
*** ViswaV has quit IRC21:59
*** ViswaV has joined #openstack-sahara22:08
*** ghenriks has quit IRC22:25
*** julienvey has quit IRC22:39
*** ViswaV has quit IRC23:07
*** ViswaV has joined #openstack-sahara23:12
*** ViswaV_ has joined #openstack-sahara23:14
*** ViswaV has quit IRC23:14
*** ViswaV has joined #openstack-sahara23:15
*** ViswaV_ has quit IRC23:15
*** ViswaV_ has joined #openstack-sahara23:16
*** ViswaV has quit IRC23:16
openstackgerritAndrew Lazarev proposed a change to openstack/sahara-image-elements: Added check on parameters without leading dash  https://review.openstack.org/11370623:50
openstackgerritAndrew Lazarev proposed a change to openstack/sahara-image-elements: Fixed parameters parsing after -d  https://review.openstack.org/11370823:52
*** witlessb has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!