*** rnirmal has joined #savanna | 00:30 | |
*** jcooley_ has quit IRC | 00:31 | |
*** IlyaE has quit IRC | 00:35 | |
*** IlyaE has joined #savanna | 00:47 | |
*** jcooley_ has joined #savanna | 00:55 | |
*** jcooley_ has quit IRC | 00:55 | |
*** chris_m has quit IRC | 00:57 | |
*** nosnos has joined #savanna | 01:04 | |
openstackgerrit | Minkyung Maisy Kim proposed a change to openstack/python-savannaclient: Adding the ability to modify cluster templates https://review.openstack.org/61925 | 01:21 |
---|---|---|
*** IlyaE has quit IRC | 01:24 | |
openstackgerrit | Minkyung Maisy Kim proposed a change to openstack/python-savannaclient: Adding the ability to modify cluster templates https://review.openstack.org/61925 | 01:27 |
*** jcooley_ has joined #savanna | 01:27 | |
*** IlyaE has joined #savanna | 01:29 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/savanna: Minor refactoring of vanilla create cluster https://review.openstack.org/63262 | 01:45 |
openstackgerrit | Andrew Lazarev proposed a change to openstack/savanna: Wait for HDFS readiness after datanode services start https://review.openstack.org/62966 | 01:55 |
*** matsuhashi has joined #savanna | 01:58 | |
*** IlyaE has quit IRC | 02:00 | |
*** jcooley_ has quit IRC | 02:12 | |
openstackgerrit | A change was merged to openstack/savanna-dashboard: Adding ability to relaunch jobs https://review.openstack.org/62398 | 02:19 |
*** jcooley_ has joined #savanna | 02:21 | |
openstackgerrit | Mina Park proposed a change to openstack/python-savannaclient: Adding the ability to modify node group templates https://review.openstack.org/62276 | 02:26 |
*** alazarev has quit IRC | 02:30 | |
*** jcooley_ has quit IRC | 02:32 | |
openstackgerrit | Mina Park proposed a change to openstack/savanna-dashboard: Adding the ability to modify node group template https://review.openstack.org/61941 | 02:32 |
*** jcooley_ has joined #savanna | 02:32 | |
*** jcooley_ has quit IRC | 02:37 | |
*** jcooley_ has joined #savanna | 02:47 | |
*** jdev789 has joined #savanna | 03:27 | |
*** jdev789 has quit IRC | 03:30 | |
*** IlyaE has joined #savanna | 04:18 | |
*** IlyaE has quit IRC | 04:25 | |
*** rnirmal has quit IRC | 04:40 | |
*** jcooley_ has quit IRC | 04:48 | |
*** jcooley_ has joined #savanna | 04:49 | |
*** jcooley_ has quit IRC | 04:53 | |
*** akuznetsov has joined #savanna | 04:53 | |
*** SergeyLukjanov has joined #savanna | 05:29 | |
*** jcooley_ has joined #savanna | 05:48 | |
*** alazarev has joined #savanna | 06:12 | |
*** SergeyLukjanov has quit IRC | 06:31 | |
*** nosnos has quit IRC | 06:41 | |
*** nosnos has joined #savanna | 06:42 | |
*** alazarev has quit IRC | 06:46 | |
*** nadya_ has joined #savanna | 06:50 | |
*** akuznetsov has quit IRC | 07:02 | |
*** nosnos_ has joined #savanna | 07:03 | |
*** nosnos has quit IRC | 07:05 | |
*** alazarev has joined #savanna | 07:05 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/savanna: Adding IDH plugin basic implementation https://review.openstack.org/63337 | 07:06 |
*** NikitaKonovalov has joined #savanna | 07:07 | |
*** nadya_ has quit IRC | 07:17 | |
*** SergeyLukjanov has joined #savanna | 07:28 | |
*** akuznetsov has joined #savanna | 07:29 | |
*** akuznetsov has quit IRC | 07:49 | |
*** akuznetsov has joined #savanna | 07:50 | |
*** akuznetsov has quit IRC | 07:54 | |
*** alazarev has quit IRC | 08:05 | |
*** aignatov has joined #savanna | 08:11 | |
*** DinaBelova has joined #savanna | 08:18 | |
*** NikitaKonovalov has quit IRC | 08:25 | |
*** NikitaKonovalov has joined #savanna | 08:25 | |
*** akuznetsov has joined #savanna | 08:37 | |
*** jcooley_ has quit IRC | 08:47 | |
*** jcooley_ has joined #savanna | 08:48 | |
*** jcooley_ has quit IRC | 08:48 | |
*** jcooley_ has joined #savanna | 08:49 | |
*** jcooley_ has quit IRC | 08:53 | |
*** dmitryme has joined #savanna | 08:58 | |
*** qwerty_nor has joined #savanna | 09:10 | |
*** matsuhashi has quit IRC | 09:12 | |
*** matsuhashi has joined #savanna | 09:12 | |
*** matsuhashi has quit IRC | 09:16 | |
*** matsuhashi has joined #savanna | 09:17 | |
openstackgerrit | Sergey Reshetnyak proposed a change to openstack/savanna: Extract common part of instances.py and instances_heat.py https://review.openstack.org/62842 | 09:18 |
*** nosnos_ has quit IRC | 09:19 | |
*** DinaBelova has quit IRC | 09:23 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 09:28 | |
*** _SergeyLukjanov has quit IRC | 09:29 | |
*** akuznetsov has quit IRC | 09:41 | |
*** matsuhashi has quit IRC | 09:41 | |
*** jcooley_ has joined #savanna | 09:46 | |
*** SergeyLukjanov has joined #savanna | 09:53 | |
openstackgerrit | Alexander Ignatov proposed a change to openstack/savanna: Added unit-tests to Heat engine https://review.openstack.org/62768 | 09:57 |
*** jcooley_ has quit IRC | 10:16 | |
*** jcooley_ has joined #savanna | 10:16 | |
*** akuznetsov has joined #savanna | 10:17 | |
*** NikitaKonovalov has quit IRC | 10:27 | |
*** jcooley_ has quit IRC | 10:49 | |
*** NikitaKonovalov has joined #savanna | 10:49 | |
openstackgerrit | Sergey Reshetnyak proposed a change to openstack/savanna: Extract common part of instances.py and instances_heat.py https://review.openstack.org/62842 | 10:50 |
*** akuznetsov has quit IRC | 10:53 | |
*** DinaBelova has joined #savanna | 11:10 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 11:13 | |
*** _SergeyLukjanov has quit IRC | 11:13 | |
*** jcooley_ has joined #savanna | 11:16 | |
*** akuznetsov has joined #savanna | 11:27 | |
*** jcooley_ has quit IRC | 11:46 | |
openstackgerrit | Sergey Reshetnyak proposed a change to openstack/savanna: Extract common part of instances.py and instances_heat.py https://review.openstack.org/62842 | 11:49 |
*** ityaptin_ has quit IRC | 11:55 | |
*** dmitryme has quit IRC | 12:01 | |
*** SergeyLukjanov has joined #savanna | 12:03 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 12:03 | |
openstackgerrit | Nikita Konovalov proposed a change to openstack/savanna-dashboard: Migrate to testr https://review.openstack.org/63390 | 12:04 |
*** _SergeyLukjanov has quit IRC | 12:05 | |
*** SergeyLukjanov has joined #savanna | 12:09 | |
*** dmitryme has joined #savanna | 12:16 | |
openstackgerrit | Dmitry Mescheryakov proposed a change to openstack/savanna: Properly catch timeout exception raised in thread https://review.openstack.org/63393 | 12:24 |
openstackgerrit | Dmitry Mescheryakov proposed a change to openstack/savanna: Increase timeout for Ambari server setup https://review.openstack.org/63396 | 12:32 |
*** jcooley_ has joined #savanna | 12:34 | |
*** DinaBelova has quit IRC | 12:41 | |
*** NikitaKonovalov has quit IRC | 12:43 | |
*** akuznetsov has quit IRC | 12:46 | |
*** ruhe has joined #savanna | 12:49 | |
*** jcooley_ has quit IRC | 12:52 | |
*** NikitaKonovalov has joined #savanna | 13:01 | |
*** akuznetsov has joined #savanna | 13:03 | |
openstackgerrit | A change was merged to openstack/savanna-image-elements: Firstboot script modifications https://review.openstack.org/61945 | 13:18 |
*** jcooley_ has joined #savanna | 13:18 | |
*** jdev789 has joined #savanna | 13:24 | |
*** tmckay has quit IRC | 13:27 | |
*** _crobertsrh is now known as crobertsrh | 13:28 | |
openstackgerrit | A change was merged to openstack/savanna-image-elements: Add possibility to use local repositories https://review.openstack.org/62352 | 13:34 |
openstackgerrit | Nikita Konovalov proposed a change to openstack/savanna-dashboard: Migrate to testr https://review.openstack.org/63390 | 13:41 |
*** aignatov has quit IRC | 13:43 | |
*** aignatov has joined #savanna | 13:44 | |
*** jcooley_ has quit IRC | 13:50 | |
*** ruhe is now known as ruhe_ | 13:53 | |
*** ruhe_ is now known as ruhe | 13:53 | |
*** NikitaKonovalov has quit IRC | 13:58 | |
*** _mattf is now known as mattf | 14:00 | |
mattf | SergeyLukjanov, how do you want to handle changes in savannaclient that require changes in savanna-api? | 14:01 |
*** akuznetsov has quit IRC | 14:01 | |
*** NikitaKonovalov has joined #savanna | 14:02 | |
*** DinaBelova has joined #savanna | 14:06 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 14:11 | |
*** jdev789 has quit IRC | 14:12 | |
*** _SergeyLukjanov has quit IRC | 14:12 | |
*** NikitaKonovalov has quit IRC | 14:14 | |
*** SergeyLukjanov has joined #savanna | 14:16 | |
*** aignatov has quit IRC | 14:18 | |
openstackgerrit | A change was merged to openstack/python-savannaclient: Adding the ability to modify cluster templates https://review.openstack.org/61925 | 14:18 |
openstackgerrit | A change was merged to openstack/python-savannaclient: Adding the ability to modify node group templates https://review.openstack.org/62276 | 14:18 |
mattf | SergeyLukjanov, how do you want to handle changes in savannaclient that require changes in savanna-api? | 14:20 |
SergeyLukjanov | mattf, hey | 14:20 |
SergeyLukjanov | such changes won't break anything, savanna-api changes are near to be merged I hope, requires 1-2 more iterations | 14:20 |
SergeyLukjanov | the only place where we need merged code in savanna-api and released client is savanna-dashboard | 14:21 |
SergeyLukjanov | I'm thinking about releasing next minor client version after updates will be fully implemented and merged | 14:22 |
mattf | aren't we serialized tho? if the new savannaclient api call uses a feature not available in savanna-api, it'll break if savanna-api isn't released first | 14:22 |
SergeyLukjanov | mattf, savanna client isn't depend on any version of savanna-api itself | 14:23 |
SergeyLukjanov | it depends on api version | 14:23 |
mattf | there's no hard dep (requirements) between client and api, which is good. so here's where api versioning comes in, ultimately | 14:23 |
SergeyLukjanov | and updates are only add new calls to the api | 14:24 |
SergeyLukjanov | that's good and will not break older client | 14:24 |
SergeyLukjanov | and will not require api version bump | 14:24 |
mattf | if folks are only using the most recent release, we need to make sure api goes out then client then dashboard | 14:24 |
mattf | if folks are using a mix of releases (say old savanna, new client, new dashboard) they're on their own, imho | 14:25 |
SergeyLukjanov | does you mean: icehouse-2 savanna with updates => 0.4.42 client release => savanna-dashboard icehouse-2 | 14:26 |
SergeyLukjanov | or just icehouse-2 savanna release => the same | 14:26 |
SergeyLukjanov | the #2 looks ok for me | 14:26 |
*** DinaBelova has quit IRC | 14:27 | |
mattf | i mean that while we're in development it should be expected that people are using the most current release of projects | 14:27 |
*** DinaBelova has joined #savanna | 14:27 | |
SergeyLukjanov | yep | 14:28 |
mattf | if we release client (and dashboard) that uses a new api call in savanna-api but we haven't yet released savanna-api that has that call, then the "always using most recent release" is safe variant is broken | 14:28 |
SergeyLukjanov | so, #1 approach looks better | 14:29 |
SergeyLukjanov | like a safe variant you mentioned | 14:29 |
*** jcooley_ has joined #savanna | 14:29 | |
mattf | (fyi, i believe andrew gets some credit there too) | 14:30 |
mattf | it means we gate the client merge on an api release that will provide the necessary new call | 14:31 |
*** NikitaKonovalov has joined #savanna | 14:32 | |
mattf | right now we might be violating the invariant | 14:32 |
SergeyLukjanov | in fact currently we always need to release client before merging tests to savanna-api due to the dependency on client in tests | 14:32 |
mattf | hey dmitry just called me a zealot, yay | 14:33 |
SergeyLukjanov | mattf, yup, next time will wait on api | 14:33 |
mattf | oh, tired eyes, not zealot, zealous | 14:34 |
* mattf needs a nap to go w/ his 4 hours of sleep | 14:34 | |
SergeyLukjanov | :) | 14:35 |
openstackgerrit | Nikita Konovalov proposed a change to openstack/savanna-dashboard: Migrate to testr https://review.openstack.org/63390 | 14:35 |
*** alazarev has joined #savanna | 14:48 | |
openstackgerrit | A change was merged to openstack/savanna: Minor refactoring of vanilla create cluster https://review.openstack.org/63262 | 14:48 |
*** tmckay has joined #savanna | 14:48 | |
*** venza has quit IRC | 14:51 | |
*** venza has joined #savanna | 14:53 | |
*** mattf is now known as _mattf | 14:54 | |
*** _mattf is now known as mattf | 14:54 | |
*** tmckay has quit IRC | 14:54 | |
*** tmckay has joined #savanna | 14:57 | |
*** jcooley_ has quit IRC | 14:59 | |
*** jcooley_ has joined #savanna | 15:01 | |
*** rnirmal has joined #savanna | 15:09 | |
*** IlyaE has joined #savanna | 15:10 | |
*** ityaptin has joined #savanna | 15:11 | |
*** IvanBerezovskiy has left #savanna | 15:19 | |
*** NikitaKonovalov has quit IRC | 15:23 | |
tmckay | crobertsrh, ping | 15:39 |
crobertsrh | hello | 15:39 |
tmckay | Looking at how to specify the "main-class" value for a java action execution. For mapreduce jobs, we specify mapper/reducer classes as config parameters. | 15:40 |
tmckay | <main-class> is its own tag, not a config property | 15:41 |
tmckay | But, I'm wondering if we just go ahead and include it in the config dictionary and then pull it out when the workflow.xml is generated | 15:41 |
tmckay | crobertsrh, but I think you mine the list of possible config parameters, right? With config hints? | 15:42 |
tmckay | So maybe that's bogus. The other alternative is for you to add a "main-class" input box if the job type is Java. What do you think? | 15:42 |
crobertsrh | Yeah, the config hints tell us which sections to display (configs, params, args) | 15:42 |
tmckay | oh, that's the other thing. The java action will be the first one with "args" | 15:43 |
crobertsrh | Adding a "main-class" input for "Java" job type is do-able. | 15:43 |
tmckay | k, I think that's the best. About args.... | 15:43 |
tmckay | There won't be any content suggested for args, because they're general and openended, but we need an indicator that you should display an "add arg" button | 15:44 |
tmckay | (or some widget) | 15:44 |
crobertsrh | Hmm, I think we already have something for args in the UI | 15:45 |
openstackgerrit | A change was merged to openstack/savanna: Increase timeout for Ambari server setup https://review.openstack.org/63396 | 15:46 |
crobertsrh | Yeah, for a Pig job right now, we have all 3 (config, params, args) | 15:46 |
tmckay | okay. Java will have configs and args, no params. Just a heads up. | 15:47 |
tmckay | quiet in here today | 15:47 |
crobertsrh | That should be ok | 15:47 |
*** tmckay has quit IRC | 16:00 | |
*** tmckay has joined #savanna | 16:15 | |
*** jcooley_ has quit IRC | 16:17 | |
*** jcooley_ has joined #savanna | 16:18 | |
*** DinaBelova has quit IRC | 16:21 | |
*** alazarev has quit IRC | 16:39 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 17:00 | |
*** _SergeyLukjanov has quit IRC | 17:00 | |
*** dmitryme has quit IRC | 17:06 | |
*** ruhe has quit IRC | 17:15 | |
*** ruhe has joined #savanna | 17:21 | |
*** tmckay1 has joined #savanna | 17:24 | |
*** tmckay has quit IRC | 17:24 | |
*** ruhe has quit IRC | 17:42 | |
*** alazarev has joined #savanna | 17:55 | |
*** alazarev has quit IRC | 18:01 | |
*** IlyaE has quit IRC | 18:18 | |
*** SergeyLukjanov has joined #savanna | 18:34 | |
*** ruhe has joined #savanna | 19:01 | |
*** jcooley_ has quit IRC | 19:03 | |
*** ruhe has quit IRC | 19:05 | |
tmckay1 | crobertsrh, hmm, for Pig arg is a dictionary, for Java actions it's just a list | 19:07 |
*** tmckay1 is now known as tmckay | 19:07 | |
crobertsrh | I see, so something a little bit different | 19:08 |
crobertsrh | args, but in a different sense | 19:08 |
crobertsrh | Maybe a new "type" then? | 19:09 |
crobertsrh | Or, given a dict, you turn it into a list? | 19:10 |
crobertsrh | the dict would look a bit funny though | 19:10 |
crobertsrh | probably not optimal | 19:10 |
tmckay | I wonder if there is a way to have a conditional property in an xml schema, or to validate against one of a number of schemas | 19:10 |
tmckay | If (Java) args is a list else it's a dict | 19:11 |
tmckay | I initially added "args" as another component, forgetting that it was in the job_configs property | 19:12 |
*** IlyaE has joined #savanna | 19:16 | |
tmckay | crobertsrh, oh yeah, "oneOf" | 19:16 |
tmckay | I think I can say that args is either a dict or a list of strings | 19:16 |
crobertsrh | Ah, that rings a bell | 19:16 |
crobertsrh | there still needs to be a way for the UI to know which form of "args" it should build. | 19:17 |
tmckay | by job_type, or better yet, something in config_hints | 19:20 |
* tmckay runs for coffee | 19:20 | |
crobertsrh | yes, configs_hints is what I was thinking of | 19:48 |
*** jdev789 has joined #savanna | 19:56 | |
*** alazarev has joined #savanna | 20:06 | |
*** jdev789 has quit IRC | 20:13 | |
*** alazarev has quit IRC | 20:24 | |
*** ityaptin has quit IRC | 20:25 | |
*** ityaptin has joined #savanna | 20:26 | |
*** mattf is now known as _mattf | 20:27 | |
*** _mattf is now known as mattf | 20:28 | |
*** jdev789 has joined #savanna | 20:29 | |
*** jdev789 has quit IRC | 20:33 | |
*** jdev789 has joined #savanna | 20:49 | |
openstackgerrit | Jonathan Maron proposed a change to openstack/savanna: Enable EDP on private neutron networks https://review.openstack.org/63517 | 20:55 |
*** jcooley_ has joined #savanna | 20:58 | |
tmckay | crobertsrh, okay, I fixed up the schemas with "oneOf". The only downside I see is that the JSON stuff replies with "blah is not valid under any of the given schemas" but doesn't tell you why it mismatched in each case | 21:07 |
tmckay | Without oneOf, the errors are more specific | 21:07 |
tmckay | But it's probably worth the trade off | 21:09 |
crobertsrh | seems ok to me | 21:12 |
tmckay | You can see the schemas at https://review.openstack.org/#/c/63156 | 21:13 |
tmckay | work in progress | 21:13 |
crobertsrh | looks simple enough :) | 21:26 |
tmckay | doh, I forgot the java_otps | 21:41 |
tmckay | opts | 21:41 |
*** alazarev has joined #savanna | 21:46 | |
*** jcooley_ has quit IRC | 21:48 | |
*** jcooley_ has joined #savanna | 21:49 | |
*** qwerty_nor has quit IRC | 21:56 | |
*** SergeyLukjanov has quit IRC | 22:22 | |
*** rnirmal has quit IRC | 22:44 | |
*** crobertsrh is now known as _crobertsrh | 22:45 | |
*** tmckay has quit IRC | 22:55 | |
*** venza has quit IRC | 23:07 | |
*** venza has joined #savanna | 23:09 | |
*** venza has quit IRC | 23:17 | |
*** venza has joined #savanna | 23:19 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!