| *** saneax has quit IRC | 00:05 | |
| *** Longgeek has joined #openstack-sahara | 00:32 | |
| *** jamielennox|away is now known as jamielennox | 00:35 | |
| *** jamielennox is now known as jamielennox|away | 01:00 | |
| *** Longgeek has quit IRC | 01:06 | |
| *** jamielennox|away is now known as jamielennox | 01:08 | |
| *** hdd has joined #openstack-sahara | 01:45 | |
| *** Networkn3rd has joined #openstack-sahara | 02:04 | |
| *** Poornima has joined #openstack-sahara | 02:06 | |
| openstackgerrit | li,chen proposed openstack/sahara-image-elements: Create a description file for each image https://review.openstack.org/190959 | 02:07 |
|---|---|---|
| openstackgerrit | lu huichun proposed openstack/sahara-specs: Add scheduling edp jobs in sahara https://review.openstack.org/175719 | 02:19 |
| *** jamielennox is now known as jamielennox|away | 02:20 | |
| *** Longgeek has joined #openstack-sahara | 02:48 | |
| *** jamielennox|away is now known as jamielennox | 03:03 | |
| *** jamielennox is now known as jamielennox|away | 03:15 | |
| *** Longgeek has quit IRC | 03:22 | |
| *** jamielennox|away is now known as jamielennox | 03:25 | |
| *** Networkn3rd has quit IRC | 03:29 | |
| *** sgotliv_ has joined #openstack-sahara | 03:55 | |
| *** Poornima has quit IRC | 04:01 | |
| *** Poornima has joined #openstack-sahara | 04:07 | |
| *** Longgeek has joined #openstack-sahara | 04:19 | |
| *** saneax has joined #openstack-sahara | 04:24 | |
| *** hdd has quit IRC | 04:26 | |
| *** Nikolay_St has joined #openstack-sahara | 04:27 | |
| *** coolsvap|away is now known as coolsvap | 04:30 | |
| *** Longgeek has quit IRC | 04:51 | |
| *** jamielennox is now known as jamielennox|away | 05:23 | |
| *** chen12 has joined #openstack-sahara | 05:24 | |
| *** jamielennox|away is now known as jamielennox | 05:26 | |
| *** coolsvap is now known as coolsvap|away | 05:28 | |
| *** hdd has joined #openstack-sahara | 05:30 | |
| *** nkrinner has joined #openstack-sahara | 05:30 | |
| *** coolsvap|away is now known as coolsvap | 05:36 | |
| *** Nikolay_St has quit IRC | 05:37 | |
| *** chlong has quit IRC | 05:38 | |
| openstackgerrit | Merged openstack/sahara-image-elements: hadoop: use a case for distro check https://review.openstack.org/192283 | 05:42 |
| *** Longgeek has joined #openstack-sahara | 05:48 | |
| *** saneax has quit IRC | 05:50 | |
| *** chlong has joined #openstack-sahara | 05:53 | |
| *** Longgeek has quit IRC | 06:14 | |
| *** hdd has quit IRC | 06:15 | |
| *** esikachev has joined #openstack-sahara | 06:43 | |
| *** coolsvap is now known as coolsvap|away | 06:53 | |
| openstackgerrit | lu huichun proposed openstack/sahara: [EDP] Add scheduling EDP jobs in sahara(oozie engine implementation) https://review.openstack.org/182310 | 06:56 |
| *** saneax has joined #openstack-sahara | 06:57 | |
| *** coolsvap|away is now known as coolsvap | 07:01 | |
| openstackgerrit | li,chen proposed openstack/sahara-specs: Expose supported elements for clusters https://review.openstack.org/178892 | 07:02 |
| *** Longgeek has joined #openstack-sahara | 07:15 | |
| *** chlong has quit IRC | 07:18 | |
| *** saneax has quit IRC | 07:26 | |
| *** coolsvap is now known as coolsvap|away | 07:34 | |
| *** Nikolay_St has joined #openstack-sahara | 07:36 | |
| *** witlessb has joined #openstack-sahara | 07:46 | |
| *** pino|work has joined #openstack-sahara | 07:47 | |
| *** Longgeek has quit IRC | 08:04 | |
| *** Longgeek has joined #openstack-sahara | 08:04 | |
| openstackgerrit | li,chen proposed openstack/sahara: Allow user to add the description file to sahara image https://review.openstack.org/193004 | 08:18 |
| openstackgerrit | li,chen proposed openstack/python-saharaclient: Allow user to add the description file to sahara image https://review.openstack.org/193006 | 08:22 |
| openstackgerrit | li,chen proposed openstack/python-saharaclient: Allow user to add the description file to sahara image https://review.openstack.org/193006 | 08:29 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: [DO NOT MERGE] Test commit https://review.openstack.org/193016 | 08:59 |
| *** esikachev has quit IRC | 09:02 | |
| *** coolsvap|away is now known as coolsvap | 09:02 | |
| *** esikachev has joined #openstack-sahara | 09:05 | |
| openstackgerrit | lu huichun proposed openstack/sahara: [EDP] Add scheduling EDP jobs in sahara(oozie engine implementation) https://review.openstack.org/182310 | 09:11 |
| *** tosky has joined #openstack-sahara | 09:24 | |
| *** saneax has joined #openstack-sahara | 09:43 | |
| openstackgerrit | Merged openstack/sahara: Update version for Liberty https://review.openstack.org/192407 | 10:08 |
| *** Nikolay_St has quit IRC | 10:12 | |
| *** Nikolay_St has joined #openstack-sahara | 10:12 | |
| *** Longgeek_ has joined #openstack-sahara | 10:20 | |
| *** Poornima has quit IRC | 10:21 | |
| *** Longgeek has quit IRC | 10:23 | |
| openstackgerrit | Merged openstack/sahara: Removed HashableDict https://review.openstack.org/191770 | 10:33 |
| openstackgerrit | Merged openstack/sahara: Switched Heat engine to ResourceGroup use https://review.openstack.org/186543 | 10:34 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Implement recommendations for vanilla 2.6.0 https://review.openstack.org/177280 | 10:40 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Implement recommendations for vanilla 2.6.0 https://review.openstack.org/177280 | 10:41 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add recommendation support for Spark plugin https://review.openstack.org/193060 | 10:50 |
| *** Nikolay_St has quit IRC | 10:55 | |
| *** Nikolay_St has joined #openstack-sahara | 10:56 | |
| *** coolsvap is now known as coolsvap|away | 10:56 | |
| openstackgerrit | Merged openstack/sahara: Refactor exception is Sahara https://review.openstack.org/191849 | 11:00 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Implement recommendations for vanilla 2.6.0 https://review.openstack.org/177280 | 11:00 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: [WIP] Add base services support for HDP 2.2 https://review.openstack.org/185100 | 11:00 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Drop support for Hadoop 1 jobs https://review.openstack.org/193069 | 11:06 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Drop support for Hadoop 1 jobs https://review.openstack.org/193069 | 11:11 |
| *** tmckay has quit IRC | 11:17 | |
| openstackgerrit | Nikita Konovalov proposed openstack/sahara: Added scaling support https://review.openstack.org/193081 | 11:40 |
| openstackgerrit | Nikita Konovalov proposed openstack/sahara: [WIP] New version of HDP plugin https://review.openstack.org/184292 | 11:41 |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Use keystone service catalog for getting auth urls https://review.openstack.org/168684 | 11:43 |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Use keystone service catalog for getting auth urls https://review.openstack.org/168684 | 11:45 |
| openstackgerrit | Nikita Konovalov proposed openstack/sahara: Added scaling support https://review.openstack.org/193081 | 11:47 |
| openstackgerrit | Nikita Konovalov proposed openstack/sahara: [WIP] Add base services support for HDP 2.2 https://review.openstack.org/185100 | 11:47 |
| openstackgerrit | Merged openstack/sahara: Updated from global requirements https://review.openstack.org/189914 | 11:52 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Added method for connect to node and run command https://review.openstack.org/185419 | 11:56 |
| *** Nikolay_St has quit IRC | 12:05 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add recommendation support for Spark plugin https://review.openstack.org/193060 | 12:11 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add recommendation support to Cloudera plugin https://review.openstack.org/193098 | 12:22 |
| *** tmckay has joined #openstack-sahara | 12:28 | |
| tellesnobrega | the meeting today is on the earlier time right? | 12:28 |
| tosky | yes | 12:28 |
| tellesnobrega | ok | 12:29 |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding Grenade support for Sahara https://review.openstack.org/193101 | 12:32 |
| *** Nikolay_St has joined #openstack-sahara | 12:33 | |
| openstackgerrit | Alexander proposed openstack/sahara: Spark jobs in Cloudera 5.3.0 plugin are now supported. Required unit tests have been added. https://review.openstack.org/193112 | 12:57 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara-specs: Configure most important hadoop configs automatically https://review.openstack.org/176294 | 13:08 |
| openstackgerrit | Alexander proposed openstack/sahara-specs: Specification for spark-jobs-for-cdh-5-3-0 added https://review.openstack.org/193120 | 13:13 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Rename all plugins to full plugin version https://review.openstack.org/188053 | 13:22 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Rename all plugins to full plugin version https://review.openstack.org/188053 | 13:28 |
| *** elmiko has joined #openstack-sahara | 13:37 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Add custom check for hbase https://review.openstack.org/190109 | 13:37 |
| *** vgridnev has joined #openstack-sahara | 13:49 | |
| *** hdd has joined #openstack-sahara | 13:59 | |
| elmiko | SergeyLukjanov: meeting? | 14:00 |
| SergeyLukjanov | elmiko, yup :) | 14:01 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Rename all plugins to full plugin version https://review.openstack.org/188053 | 14:01 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Temporary use local repo for mapr eco https://review.openstack.org/191754 | 14:02 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Use PyMySQL in connection string for DB tests https://review.openstack.org/193141 | 14:07 |
| openstackgerrit | Alexander proposed openstack/sahara: Spark job for Cloudera 5.3.0. added https://review.openstack.org/193112 | 14:14 |
| *** nkrinner has quit IRC | 14:17 | |
| *** egafford has joined #openstack-sahara | 14:20 | |
| *** Nikolay_St has quit IRC | 14:25 | |
| *** hdd has quit IRC | 14:28 | |
| *** hdd has joined #openstack-sahara | 14:30 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/python-saharaclient: Add support of use_autoconfig field https://review.openstack.org/193157 | 14:44 |
| *** Networkn3rd has joined #openstack-sahara | 14:59 | |
| tellesnobrega | elmiko, clusters API is all implemente in v1.0, should i add the multiple cluster in v1.1 or 1.0? | 15:03 |
| vgridnev | tellesnobrega, I suppose in 1.0 | 15:04 |
| vgridnev | show_progress was added to v1.0 | 15:04 |
| tellesnobrega | vgridnev, great, i agree with that | 15:04 |
| elmiko | um... | 15:04 |
| tellesnobrega | actually i've already implemented it there | 15:05 |
| elmiko | as long as the endpoint can be reached from an /v1.1/.... call, i suppose it's fine | 15:05 |
| tellesnobrega | sure, i will take a look into that, see if it works | 15:10 |
| tellesnobrega | elmiko, thank | 15:10 |
| tellesnobrega | thanks | 15:10 |
| elmiko | np, sounds good tellesnobrega | 15:10 |
| *** saneax has quit IRC | 15:12 | |
| *** vgridnev has quit IRC | 15:16 | |
| SergeyLukjanov | tmckay, thx for ending meeting | 15:23 |
| SergeyLukjanov | it was a network issue | 15:23 |
| SergeyLukjanov | :( | 15:23 |
| tmckay | lol, I thought it was worth a try | 15:25 |
| tmckay | can anybody end, or was I a chairman? | 15:25 |
| tmckay | SergeyLukjanov ^6 | 15:26 |
| *** vgridnev has joined #openstack-sahara | 15:26 | |
| *** vgridnev has quit IRC | 15:26 | |
| SergeyLukjanov | tmckay, I think anybody can end now | 15:31 |
| tmckay | good to know | 15:34 |
| *** esikachev has quit IRC | 15:36 | |
| *** Nikolay_St has joined #openstack-sahara | 15:48 | |
| *** pino|work has quit IRC | 15:52 | |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Rename all plugins to full plugin version https://review.openstack.org/188053 | 15:57 |
| *** saneax has joined #openstack-sahara | 16:07 | |
| openstackgerrit | Merged stackforge/sahara-ci-config: Drop support for Hadoop 1 jobs https://review.openstack.org/193069 | 16:08 |
| *** openstackgerrit has quit IRC | 16:22 | |
| *** openstackgerrit has joined #openstack-sahara | 16:23 | |
| tellesnobrega | elmiko, wrote the change on v1.0 and called using v1.1 and worked | 16:43 |
| elmiko | tellesnobrega: awesome! | 16:43 |
| tellesnobrega | i have one question about quotas checking | 16:44 |
| tellesnobrega | i'm implementing checking quotas on the go, if we are creating 2 clusters, it will check quotas on the creation of each clusters | 16:45 |
| tellesnobrega | the test i did here (using devstack) trying to go over the quota, the first cluster was created and the second failed... in this case, what should the response be? | 16:46 |
| elmiko | tellesnobrega: 1sec, i'm running a meeting for another 15min. | 16:47 |
| tellesnobrega | sure | 16:48 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Rename all plugins to full plugin version https://review.openstack.org/188053 | 16:57 |
| elmiko | tellesnobrega: hmm, good question. let me look at the guidelines for a second, i think we have something on partial collection creation | 17:02 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Rename all plugins to full plugin version https://review.openstack.org/188053 | 17:14 |
| tellesnobrega | elmiko, ok | 17:14 |
| elmiko | tellesnobrega: still looking | 17:15 |
| tellesnobrega | sure np | 17:15 |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara-specs: Allow multiple clusters creation simultaneously https://review.openstack.org/188011 | 17:18 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Temporary use local repo for mapr eco https://review.openstack.org/191754 | 17:20 |
| elmiko | tellesnobrega: are we going to allow the created clusters to stay? | 17:25 |
| tellesnobrega | i think we should, IMHO | 17:25 |
| elmiko | hmm | 17:26 |
| elmiko | tellesnobrega: i need to read the review again, but how does the api call go, do you ask for the whole group of clusters then poll the result? | 17:30 |
| elmiko | (on the collection, that is) | 17:30 |
| tellesnobrega | right now, i'm returning a dict ({'clusters':[{'cluster':...}, {'cluster':...}]} | 17:31 |
| tellesnobrega | something like that | 17:31 |
| elmiko | yea | 17:31 |
| elmiko | i need to verify something, looking for the partial success response | 17:31 |
| tellesnobrega | thanks | 17:34 |
| elmiko | tellesnobrega: this is a tough one, because you can have partial success | 17:34 |
| tellesnobrega | can? | 17:38 |
| elmiko | well like, you POST to .../clusters/multiple | 17:38 |
| elmiko | and some of them are created, but some aren't (due to quota) | 17:39 |
| elmiko | so, it's like you are creating a collection that allows partial success | 17:39 |
| tellesnobrega | yes | 17:39 |
| elmiko | although, it's not really a collection since you can't GET from .../clusters/multiple/<collection id> | 17:39 |
| tellesnobrega | the problem is how do i tell the user that the call partially worked | 17:39 |
| elmiko | as it stands right now, this is just a convenience task | 17:40 |
| elmiko | it would be better if a true collection was created. | 17:41 |
| elmiko | because, | 17:41 |
| elmiko | what if a user does a POST .../clusters/multiple and requests a group of 3 | 17:41 |
| elmiko | then another POST requesting a group of 4 for a different template id | 17:41 |
| elmiko | ? | 17:41 |
| elmiko | imo, the way it stands, you can only return a list of the cluster ids and then allow the user to query those individual clusters. | 17:42 |
| elmiko | we can't allow them to operate as if this is a resource of its own, ie a collection of clusters | 17:43 |
| elmiko | this is why i want the /tasks endpoint for v2 api | 17:43 |
| elmiko | then we could do this | 17:43 |
| elmiko | does that make sense? | 17:43 |
| *** openstackgerrit has quit IRC | 17:50 | |
| *** openstackgerrit has joined #openstack-sahara | 17:51 | |
| *** saneax has quit IRC | 17:51 | |
| elmiko | tellesnobrega: is it ever the case that the cluster objects won't be created? | 17:55 |
| elmiko | for example can you create the cluster objects, only for them to fail during provisioning if quota is exceeded? | 17:55 |
| elmiko | tellesnobrega: i'll add comments on the review. i need to afk for a while | 17:58 |
| *** tosky has quit IRC | 18:04 | |
| *** elmiko has quit IRC | 18:27 | |
| *** elmiko has joined #openstack-sahara | 18:29 | |
| tellesnobrega | elmiko, sorry, was busy... im ok with returning just a list of clusters id that actually got created | 18:30 |
| tellesnobrega | elmiko, the idea is to create the clusters all together, but after that they will behave the same as today | 18:31 |
| tellesnobrega | regarding your question about the object being created, i'm not sure if anything blocks the creation of the object | 18:32 |
| elmiko | tellesnobrega: ok, it would be nice if we just returned a list of ids/hrefs to the newly created items, | 18:32 |
| elmiko | then the user is responsible to checking the individual cluster states | 18:32 |
| tellesnobrega | +1 | 18:33 |
| elmiko | basically POST to /cluster/multiple would almost always return 200 in that case | 18:33 |
| elmiko | or 202, whatever CREATED is | 18:33 |
| tellesnobrega | ok | 18:33 |
| tellesnobrega | i'm gonna add that to the spec | 18:33 |
| elmiko | tellesnobrega: nice, thanks! | 18:33 |
| elmiko | for the record, i don't like the endpoint we are creating, but i can't think of a better way to do it | 18:34 |
| elmiko | (well, not without a /tasks endpoint) | 18:34 |
| tellesnobrega | yeah, that wasn't my first option either | 18:35 |
| elmiko | i know | 18:35 |
| tellesnobrega | on the spec, response should be 200 or a list of ids? | 18:35 |
| tellesnobrega | or 202 | 18:35 |
| elmiko | 201, and an object { 'clusters': [ 'id', 'id', ...]} | 18:37 |
| elmiko | imo | 18:37 |
| *** hdd has quit IRC | 18:37 | |
| elmiko | or even better would be, { 'clusters': ['href', 'href', ...]} | 18:38 |
| elmiko | where href is in the form '/v1.1/<proj id>/clusters/<cluster id>' | 18:38 |
| elmiko | but maybe just best to stick with id's to begin with | 18:39 |
| elmiko | we can save href relative stuff for v2 | 18:39 |
| *** hdd has joined #openstack-sahara | 18:44 | |
| tellesnobrega | i like that | 18:48 |
| openstackgerrit | Ethan Gafford proposed openstack/sahara: [EDP] Unified Map to Define Job Interface https://review.openstack.org/187809 | 19:04 |
| openstackgerrit | Merged openstack/sahara-specs: [EDP] Allow editing job binaries https://review.openstack.org/174045 | 19:06 |
| openstackgerrit | Merged openstack/sahara-specs: [EDP] Allow editing datasource objects https://review.openstack.org/174019 | 19:06 |
| *** hdd has quit IRC | 19:11 | |
| *** hdd has joined #openstack-sahara | 19:21 | |
| *** uschreiber_ has joined #openstack-sahara | 19:23 | |
| *** uschreiber_ has quit IRC | 19:25 | |
| *** vgridnev has joined #openstack-sahara | 19:41 | |
| *** Longgeek_ has quit IRC | 19:43 | |
| *** hdd has quit IRC | 20:00 | |
| *** Nikolay_St has quit IRC | 20:06 | |
| *** Nikolay_St has joined #openstack-sahara | 20:06 | |
| *** Nikolay_St has quit IRC | 20:17 | |
| *** Nikolay_St has joined #openstack-sahara | 20:18 | |
| *** hdd has joined #openstack-sahara | 20:26 | |
| *** luke-solinea has quit IRC | 20:27 | |
| *** ViswaV has joined #openstack-sahara | 20:28 | |
| *** hdd has quit IRC | 20:36 | |
| *** hdd has joined #openstack-sahara | 20:37 | |
| vgridnev | sahara guys, need some help with review: https://review.openstack.org/#/q/owner:%22Vitaly+Gridnev%22+status:open,n,z | 20:42 |
| *** Longgeek has joined #openstack-sahara | 20:44 | |
| elmiko | vgridnev: got it bookmarked, will take a look tonight | 20:46 |
| *** elmiko is now known as _elmiko | 20:46 | |
| vgridnev | thanks | 20:50 |
| *** tmckay has left #openstack-sahara | 21:00 | |
| *** jamielennox is now known as jamielennox|away | 21:01 | |
| *** raildo has quit IRC | 21:06 | |
| *** jamielennox|away is now known as jamielennox | 21:09 | |
| *** Longgeek has quit IRC | 21:19 | |
| *** htruta_ has joined #openstack-sahara | 21:23 | |
| *** _elmiko is now known as elmiko | 21:23 | |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara-specs: Allow multiple clusters creation simultaneously https://review.openstack.org/188011 | 21:26 |
| tellesnobrega | elmiko, ^ | 21:26 |
| elmiko | tellesnobrega: ack, added to my queue ;) | 21:27 |
| tellesnobrega | thanks | 21:27 |
| tellesnobrega | i gotta go, i have a 3h class waiting for me (and it is 18:26 here) | 21:27 |
| elmiko | oh wow, good luck! | 21:27 |
| *** vgridnev has quit IRC | 21:58 | |
| *** egafford has quit IRC | 22:00 | |
| *** elmiko is now known as _elmiko | 22:35 | |
| *** witlessb has quit IRC | 22:54 | |
| *** openstackgerrit has quit IRC | 22:55 | |
| *** tellesnobrega has quit IRC | 22:55 | |
| *** alazarev has quit IRC | 22:55 | |
| *** openstackgerrit has joined #openstack-sahara | 23:06 | |
| *** tellesnobrega has joined #openstack-sahara | 23:06 | |
| *** alazarev has joined #openstack-sahara | 23:06 | |
| *** Longgeek has joined #openstack-sahara | 23:16 | |
| *** Longgeek has quit IRC | 23:34 | |
| *** chlong has joined #openstack-sahara | 23:47 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!