| *** sreshetn2 has joined #openstack-sahara | 00:06 | |
| *** sreshetn2 has quit IRC | 00:10 | |
| *** jamielennox|away is now known as jamielennox | 00:28 | |
| *** witlessb has quit IRC | 00:30 | |
| *** Longgeek has joined #openstack-sahara | 02:36 | |
| *** stanchan has joined #openstack-sahara | 03:10 | |
| *** elmiko has quit IRC | 03:41 | |
| *** elmiko has joined #openstack-sahara | 03:42 | |
| *** Poornima has joined #openstack-sahara | 04:43 | |
| *** Poornima has quit IRC | 05:20 | |
| *** Longgeek has quit IRC | 05:23 | |
| *** Longgeek has joined #openstack-sahara | 05:24 | |
| *** Poornima has joined #openstack-sahara | 05:31 | |
| *** sgotliv has joined #openstack-sahara | 05:37 | |
| *** sgotliv has quit IRC | 05:46 | |
| *** sreshetn2 has joined #openstack-sahara | 06:32 | |
| *** esikachev has joined #openstack-sahara | 06:49 | |
| *** esikachev has quit IRC | 06:50 | |
| *** esikachev has joined #openstack-sahara | 06:52 | |
| *** sreshetn2 has quit IRC | 06:59 | |
| *** witlessb has joined #openstack-sahara | 07:03 | |
| *** Poornima has quit IRC | 07:07 | |
| *** sreshetn2 has joined #openstack-sahara | 07:16 | |
| *** Poornima has joined #openstack-sahara | 07:20 | |
| *** jamielennox is now known as jamielennox|away | 07:20 | |
| *** tnovacik has joined #openstack-sahara | 07:31 | |
| *** pino|work has joined #openstack-sahara | 07:44 | |
| *** skolekonov has joined #openstack-sahara | 08:06 | |
| *** sreshetn2 has quit IRC | 08:21 | |
| *** kingbhanu has joined #openstack-sahara | 08:30 | |
| *** sreshetn2 has joined #openstack-sahara | 08:31 | |
| *** kingbhanu has quit IRC | 08:50 | |
| *** IBerezovskiy has joined #openstack-sahara | 09:04 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Use jsonutils from oslo.serialization https://review.openstack.org/172083 | 09:05 |
|---|---|---|
| *** deepi has joined #openstack-sahara | 09:24 | |
| deepi | hie evryone | 09:25 |
| *** deepi has left #openstack-sahara | 09:25 | |
| *** tosky has joined #openstack-sahara | 09:25 | |
| tosky | I think we can change the topic of the channel... | 09:48 |
| *** sreshetn2 has quit IRC | 10:33 | |
| *** sreshetn2 has joined #openstack-sahara | 10:34 | |
| *** sreshetn2 has quit IRC | 10:44 | |
| *** IBerezovskiy has quit IRC | 11:06 | |
| *** sreshetn2 has joined #openstack-sahara | 11:10 | |
| *** AndreyPavlov has quit IRC | 11:12 | |
| *** AndreyPavlov has joined #openstack-sahara | 11:20 | |
| *** sreshetn2 has quit IRC | 11:25 | |
| *** sreshetn1 has joined #openstack-sahara | 11:37 | |
| *** _crobertsrh has quit IRC | 11:59 | |
| *** crobertsrh has joined #openstack-sahara | 12:04 | |
| *** Poornima has quit IRC | 12:08 | |
| *** dmitryme has joined #openstack-sahara | 12:15 | |
| tellesnobrega | tmckay, ping | 12:19 |
| tmckay | tellesnobrega, hi | 12:26 |
| tellesnobrega | tmckay, i'm trying to create a storm job template. The verification I set to verify if the topology_name is in the template... but if i put the topology_name i get an exception that it was unexpected | 12:28 |
| tmckay | tellesnobrega, it would have to be added as a config, otherwise the schema has to be modified. So job configs would look like {"configs": {"topology_name": "name"}} | 12:30 |
| tmckay | I'm guessing maybe you put it somewhere else, and the schema validator doesn't like it | 12:30 |
| tmckay | This is where we put everything that is not general to all job types. The schema accepts any number of configs, args, and params. but fields outside of that have to be explicitly added | 12:31 |
| tmckay | tellesnobrega, are you doing this with the python client, or through the UI? | 12:31 |
| tmckay | if you're doing it with the client or REST, can you pastebin the JSON for me? | 12:32 |
| * tmckay grabs some breakfast | 12:32 | |
| *** sreshetn1 has quit IRC | 12:33 | |
| tellesnobrega | tmckay, sure...http://paste.openstack.org/show/201989/ | 12:34 |
| tmckay | tellesnobrega, oh, yes, for certain. topology_name needs to be moved into configs | 12:41 |
| tellesnobrega | tmckay, i changed it to this http://paste.openstack.org/show/201991/ | 12:42 |
| tmckay | tellesnobrega, we have a convention for configs consumed by Sahara, like the main class for Java/Spark | 12:42 |
| tellesnobrega | and got the same message... config not expected | 12:42 |
| tellesnobrega | should it be {"configs":...} | 12:42 |
| tellesnobrega | or configs i just put when i'm launching a job? | 12:43 |
| *** sreshetn1 has joined #openstack-sahara | 12:44 | |
| tmckay | http://docs.openstack.org/developer/sahara/restapi/rest_api_v1.1_EDP.html#execute-job | 12:44 |
| tmckay | tellesnobrega, you need "job_configs" ^^ | 12:44 |
| tmckay | so "job_configs": {"configs": {}} | 12:45 |
| tellesnobrega | tmckay, ok, so the creation of the template doesnt take configs | 12:45 |
| tmckay | tellesnobrega, yes, configs when you launch the job | 12:45 |
| tmckay | correct | 12:45 |
| tmckay | tellesnobrega, is the topology name important to the user? It could be generated -- like, the name of the job plus a uuid? | 12:46 |
| tmckay | that way it wouldn't have to be specified but would still be unique and based on the job | 12:46 |
| tellesnobrega | sounds good | 12:47 |
| tmckay | If it does need to be specified as a config, it should be "edp.storm.topology_name" | 12:48 |
| tmckay | That is our convention for config values that are consumed by Sahara, instead of passed on to the job at runtime (or the executor, like Oozie) | 12:48 |
| tmckay | but auto generation makes sense to me | 12:48 |
| tellesnobrega | tmckay, makes sense to me too... the only think we need is for it to be unique... using uuid makes it happen | 12:50 |
| tellesnobrega | so i'm ok with it | 12:50 |
| tmckay | okay, great | 12:50 |
| tellesnobrega | thanks | 12:50 |
| tmckay | np | 12:50 |
| * tmckay back in a little bit | 12:50 | |
| *** sreshetn1 has quit IRC | 12:54 | |
| openstackgerrit | Merged openstack/sahara: Switched heat engine from JSON to HOT https://review.openstack.org/157623 | 13:00 |
| *** sreshetn1 has joined #openstack-sahara | 13:03 | |
| *** hdd has joined #openstack-sahara | 13:07 | |
| *** hdd has quit IRC | 13:09 | |
| *** sreshetn1 has quit IRC | 13:09 | |
| *** pino|work has quit IRC | 13:50 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: {WIP} Introduce request_id in context for better logging https://review.openstack.org/172426 | 13:52 |
| *** pino|work has joined #openstack-sahara | 13:56 | |
| tellesnobrega | tmckay, once i generate the topology name, where should I store it? can i put it in the job_configs dict? it is needed to retrieve job information | 13:58 |
| tmckay | tellesnobrega, for Spark, I put some stuff in the "info" field of the job execution. It's returned from run_job(), I believe. I store the PID of the launcher process on the master node so that I can check the process status. | 13:59 |
| tmckay | that I think would be the best place | 13:59 |
| tellesnobrega | tmckay, great | 13:59 |
| tmckay | you can look and see how spark edp returns it, and how the job_manager stores it | 14:00 |
| tellesnobrega | doing it | 14:00 |
| *** sreshetn1 has joined #openstack-sahara | 14:03 | |
| *** tellesnobrega has left #openstack-sahara | 14:04 | |
| *** tellesnobrega has joined #openstack-sahara | 14:04 | |
| *** hdd has joined #openstack-sahara | 14:06 | |
| *** tnovacik has quit IRC | 14:23 | |
| *** hdd has quit IRC | 14:26 | |
| *** hdd has joined #openstack-sahara | 14:32 | |
| *** esikachev has quit IRC | 15:13 | |
| *** mattf is now known as _mattf | 15:18 | |
| *** hdd has quit IRC | 15:38 | |
| -openstackstatus- NOTICE: gerrit has been restarted to address a hung event stream. change events between 15:00 and 15:43 utc which were lost will need to be rechecked or have approval workflow votes reapplied for zuul to act on them | 15:45 | |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: TEST COMMIT https://review.openstack.org/172490 | 16:01 |
| *** pino|work has quit IRC | 16:08 | |
| *** hdd has joined #openstack-sahara | 16:12 | |
| *** hdd has quit IRC | 16:18 | |
| openstackgerrit | Mikhail Ivanov proposed openstack/sahara-image-elements: Not dib elements scripts was adapted to dib-lint checks https://review.openstack.org/172008 | 16:26 |
| openstackgerrit | Denis Egorenko proposed openstack/sahara: Rename templates in scenario yaml files https://review.openstack.org/166933 | 16:59 |
| openstackgerrit | Denis Egorenko proposed openstack/sahara: Put in Sahara repo actual scenario files https://review.openstack.org/172513 | 17:00 |
| *** sgotliv has joined #openstack-sahara | 17:10 | |
| *** sreshetn1 has quit IRC | 17:14 | |
| *** sreshetn1 has joined #openstack-sahara | 17:26 | |
| *** sgotliv has quit IRC | 17:29 | |
| openstackgerrit | Mikhail Ivanov proposed openstack/sahara-image-elements: Adapt not dib elements to dib-lint checks https://review.openstack.org/172008 | 17:29 |
| *** sreshetn1 has quit IRC | 17:34 | |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Add 'proposed/kilo' branch https://review.openstack.org/172519 | 17:39 |
| *** Longgeek has quit IRC | 17:52 | |
| *** tosky has quit IRC | 18:16 | |
| openstackgerrit | Merged stackforge/sahara-ci-config: Add 'proposed/kilo' branch https://review.openstack.org/172519 | 18:48 |
| *** degorenko has quit IRC | 18:54 | |
| *** sreshetn1 has joined #openstack-sahara | 19:01 | |
| crobertsrh | Time for a review rampage. Anything require immediate attention? | 19:09 |
| *** hdd has joined #openstack-sahara | 19:14 | |
| *** hdd has quit IRC | 19:38 | |
| *** hdd has joined #openstack-sahara | 19:41 | |
| *** hdd_ has joined #openstack-sahara | 19:50 | |
| *** hdd has quit IRC | 19:52 | |
| openstackgerrit | Michael McCune proposed openstack/sahara: Adding config hints for vanilla plugin https://review.openstack.org/167420 | 20:09 |
| openstackgerrit | Michael McCune proposed openstack/sahara: Adding config hints for HDP plugin https://review.openstack.org/166494 | 20:09 |
| *** sreshetn1 has quit IRC | 20:20 | |
| *** elmiko has quit IRC | 20:25 | |
| *** elmiko has joined #openstack-sahara | 20:26 | |
| *** hdd_ has quit IRC | 20:35 | |
| *** crobertsrh is now known as _crobertsrh | 21:16 | |
| *** saurabhs has joined #openstack-sahara | 21:31 | |
| *** saurabhs has quit IRC | 21:41 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!