| *** sgotliv_ has quit IRC | 00:02 | |
| *** jamielennox|away is now known as jamielennox | 00:05 | |
| *** tmckay has joined #openstack-sahara | 00:33 | |
| *** stanchan has quit IRC | 00:36 | |
| *** witlessb has quit IRC | 00:54 | |
| *** jinxing has joined #openstack-sahara | 00:56 | |
| *** coolsvap has quit IRC | 01:23 | |
| *** coolsvap has joined #openstack-sahara | 01:25 | |
| *** links has joined #openstack-sahara | 01:27 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/254480 | 02:11 |
|---|---|---|
| jinxing | Hi guys. qpid is no longer support in the sahara? | 02:13 |
| openstackgerrit | Jinxing Fang proposed openstack/sahara: remove the Qpid message driver https://review.openstack.org/254491 | 02:22 |
| *** itisha has quit IRC | 02:26 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/254480 | 02:34 |
| openstackgerrit | Jinxing Fang proposed openstack/sahara: remove the Qpid message driver https://review.openstack.org/254507 | 02:40 |
| *** jinxing has quit IRC | 02:40 | |
| openstackgerrit | Jaxon Wang proposed openstack/sahara-specs: Code refactoring for CDH plugin https://review.openstack.org/245193 | 02:43 |
| openstackgerrit | Jinxing Fang proposed openstack/sahara: remove the Qpid message driver https://review.openstack.org/254507 | 02:45 |
| openstackgerrit | Jinxing Fang proposed openstack/sahara: remove the Qpid config guide https://review.openstack.org/254511 | 02:48 |
| *** _mattf is now known as mattf | 03:07 | |
| *** mattf is now known as _mattf | 03:08 | |
| openstackgerrit | Merged openstack/puppet-sahara: Remove qpid messaging support https://review.openstack.org/253105 | 03:19 |
| openstackgerrit | Akanksha proposed openstack/sahara: Adds nosec to system call in NetcatSocket._terminate https://review.openstack.org/254277 | 03:42 |
| openstackgerrit | Jinxing Fang proposed openstack/sahara: remove the qpid message driver from the configuration file https://review.openstack.org/254533 | 03:52 |
| *** ViswaV has quit IRC | 04:34 | |
| *** ViswaV has joined #openstack-sahara | 04:38 | |
| *** Poornima has joined #openstack-sahara | 05:21 | |
| *** vgridnev has joined #openstack-sahara | 05:24 | |
| openstackgerrit | Xi Yang proposed openstack/sahara: Clean the code in vanilla's utils https://review.openstack.org/254552 | 05:56 |
| openstackgerrit | Jinxing Fang proposed openstack/sahara: remove the qpid message driver from the configuration file https://review.openstack.org/254564 | 06:21 |
| *** sgotliv_ has joined #openstack-sahara | 06:22 | |
| *** stanchan has joined #openstack-sahara | 06:31 | |
| *** hdd has quit IRC | 07:11 | |
| *** nkrinner has joined #openstack-sahara | 07:22 | |
| openstackgerrit | Merged openstack/sahara-dashboard: Adding support for Manila-based shares in Sahara https://review.openstack.org/253169 | 07:54 |
| *** stanchan has quit IRC | 08:01 | |
| *** stanchan has joined #openstack-sahara | 08:02 | |
| *** stanchan has quit IRC | 08:03 | |
| openstackgerrit | Jinxing Fang proposed openstack/sahara: remove the qpid message driver from the configuration file https://review.openstack.org/254564 | 08:10 |
| *** tmckay has quit IRC | 08:33 | |
| *** vgridnev has quit IRC | 08:43 | |
| *** tmckay has joined #openstack-sahara | 08:47 | |
| openstackgerrit | Merged openstack/sahara: Optimize "open" method with context manager https://review.openstack.org/250699 | 08:52 |
| *** links has quit IRC | 08:55 | |
| *** links has joined #openstack-sahara | 09:09 | |
| *** witlessb has joined #openstack-sahara | 09:09 | |
| *** shakamunyi has joined #openstack-sahara | 09:13 | |
| *** _degorenko|afk is now known as degorenko | 09:15 | |
| *** shakamunyi has quit IRC | 09:23 | |
| *** datainadequate has joined #openstack-sahara | 09:23 | |
| *** vgridnev has joined #openstack-sahara | 09:35 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara: [TEST COMMIT] CDH HA https://review.openstack.org/254083 | 10:11 |
| *** links has quit IRC | 10:37 | |
| *** witlessb has quit IRC | 10:47 | |
| *** tosky has joined #openstack-sahara | 10:52 | |
| *** links has joined #openstack-sahara | 10:58 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/254480 | 11:01 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara-dashboard: Updated from global requirements https://review.openstack.org/254689 | 11:01 |
| openstackgerrit | Denis Egorenko proposed openstack/puppet-sahara: Fix defaults for doc section https://review.openstack.org/253528 | 11:01 |
| *** openstackgerrit has quit IRC | 11:02 | |
| *** openstackgerrit has joined #openstack-sahara | 11:03 | |
| openstackgerrit | Merged openstack/sahara-dashboard: [Sahara] Get urls of datasources safer https://review.openstack.org/253141 | 11:12 |
| *** datainadequate has quit IRC | 11:25 | |
| *** jinxing has joined #openstack-sahara | 11:40 | |
| openstackgerrit | Merged openstack/sahara-dashboard: Updated from global requirements https://review.openstack.org/254689 | 11:46 |
| *** witlessb has joined #openstack-sahara | 11:51 | |
| *** datainadequate has joined #openstack-sahara | 12:17 | |
| *** witlessb has quit IRC | 12:27 | |
| *** links has quit IRC | 12:36 | |
| *** witlessb has joined #openstack-sahara | 12:37 | |
| openstackgerrit | Merged openstack/python-saharaclient: remove netaddr from requirements https://review.openstack.org/252822 | 12:39 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/254480 | 12:40 |
| *** witlessb has quit IRC | 12:43 | |
| *** Akanksha08 has joined #openstack-sahara | 12:44 | |
| openstackgerrit | Jinxing Fang proposed openstack/sahara: remove the qpid message driver from the configuration file https://review.openstack.org/254564 | 13:04 |
| openstackgerrit | Merged openstack/sahara: Remove MANIFEST.in https://review.openstack.org/253956 | 13:31 |
| *** itisha has joined #openstack-sahara | 13:33 | |
| *** Poornima has quit IRC | 13:46 | |
| *** _crobertsrh is now known as crobertsrh | 13:49 | |
| *** tmckay has quit IRC | 13:53 | |
| *** tmckay has joined #openstack-sahara | 13:55 | |
| *** akuznetsov has joined #openstack-sahara | 14:02 | |
| *** jinxing has quit IRC | 14:03 | |
| *** datainadequate has quit IRC | 14:04 | |
| vgridnev | tmckay, did you have any issues with writing to swift outputs in spark? | 14:05 |
| vgridnev | I've just faced with issues like that: "WARN scheduler.TaskSetManager: Lost task 0.0 in stage 2.0 (TID 4, 192.168.111.210): java.io.IOException: Permission denied" | 14:08 |
| elmiko | vgridnev: did you pass in the credentials? | 14:12 |
| vgridnev | of course | 14:13 |
| elmiko | had to ask ;) | 14:13 |
| vgridnev | i works fine if I'm using swift as input, but it something doesn't work if I'm starting to use that for outputs | 14:14 |
| elmiko | hmm, so it can read from swift | 14:14 |
| *** datainadequate has joined #openstack-sahara | 14:16 | |
| *** datainadequate has quit IRC | 14:18 | |
| elmiko | vgridnev: does it write anything? (this isn't a case where it's failing to append) | 14:19 |
| vgridnev | elmiko, yes, it writes some temporary stuff | 14:20 |
| elmiko | in swift? | 14:20 |
| vgridnev | yes | 14:20 |
| elmiko | but not the final output? | 14:20 |
| elmiko | i'm just wondering if it's trying to perform an operation that swift doesn't permit (eg append) | 14:21 |
| vgridnev | yes | 14:21 |
| vgridnev | hm | 14:21 |
| openstackgerrit | Chad Roberts proposed openstack/sahara-dashboard: Adding manila shares as an option for data sources https://review.openstack.org/253186 | 14:22 |
| tmckay | vgridnev, no, never saw that one | 14:23 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-specs: Move sahara tests to seperate repository https://review.openstack.org/250419 | 14:27 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/254480 | 14:33 |
| vgridnev | elmiko, let's image that we have issues with append. How to resolve that? | 14:35 |
| elmiko | vgridnev: i imagine you would need to construct your spark app in a manner that didn't use append | 14:38 |
| elmiko | and if spark is doing it automatically, then we'll need to document the behavior betwen spark and swift | 14:39 |
| vgridnev | but actually the same job works fine with swift outputs in case of spark with cdh | 14:41 |
| elmiko | interesting | 14:43 |
| elmiko | maybe an issue with openstack-hadoop.jar? | 14:43 |
| elmiko | are the spark versions the same? | 14:43 |
| *** akuznetsov has quit IRC | 14:49 | |
| vgridnev | elmiko, I'm using hadoop-swift.jar | 14:50 |
| *** datainadequate has joined #openstack-sahara | 14:51 | |
| elmiko | vgridnev: is that a new one you generated from sahara-extra? | 14:53 |
| vgridnev | no | 14:55 |
| vgridnev | it was the one that uploaded to sahara-files | 14:56 |
| vgridnev | I will retry with new one hadoop-openstack jar file | 14:56 |
| crobertsrh | vgridnev: Looks like the netifaces issue has been sorted out. https://review.openstack.org/#/c/254519/ | 15:07 |
| *** jinxing has joined #openstack-sahara | 15:15 | |
| *** tosky has quit IRC | 15:25 | |
| *** akuznetsov has joined #openstack-sahara | 15:26 | |
| *** tosky has joined #openstack-sahara | 15:26 | |
| vgridnev | crobertsrh, should we remove that from requirements ? | 15:27 |
| crobertsrh | We probably can | 15:34 |
| crobertsrh | Not urgent though, I suppose | 15:35 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-specs: Move sahara tests to seperate repository https://review.openstack.org/250419 | 15:35 |
| *** hdd has joined #openstack-sahara | 15:51 | |
| *** nkrinner has quit IRC | 15:53 | |
| *** hdd has quit IRC | 15:57 | |
| openstackgerrit | Merged openstack/puppet-sahara: Fix defaults for doc section https://review.openstack.org/253528 | 16:00 |
| *** vgridnev has quit IRC | 16:00 | |
| *** hdd has joined #openstack-sahara | 16:07 | |
| *** tmckay has quit IRC | 16:13 | |
| *** openstackgerrit has quit IRC | 16:47 | |
| *** openstackgerrit has joined #openstack-sahara | 16:47 | |
| *** degorenko is now known as _degorenko|afk | 16:53 | |
| *** vgridnev has joined #openstack-sahara | 16:53 | |
| *** crobertsrh1 has joined #openstack-sahara | 17:12 | |
| *** tmckay has joined #openstack-sahara | 17:12 | |
| *** hdd has quit IRC | 17:14 | |
| openstackgerrit | Chad Roberts proposed openstack/sahara-dashboard: Adding node group template support for shares https://review.openstack.org/253203 | 17:15 |
| *** witlessb has joined #openstack-sahara | 17:29 | |
| *** akuznetsov has quit IRC | 17:34 | |
| *** akuznetsov has joined #openstack-sahara | 17:36 | |
| *** akuznetsov has quit IRC | 17:40 | |
| *** akuznetsov has joined #openstack-sahara | 17:40 | |
| *** akuznetsov has quit IRC | 17:40 | |
| *** ViswaV has quit IRC | 17:44 | |
| *** ViswaV has joined #openstack-sahara | 17:47 | |
| *** shakamunyi has joined #openstack-sahara | 18:25 | |
| *** datainadequate has quit IRC | 18:27 | |
| *** crobertsrh1 has quit IRC | 18:43 | |
| *** david-ly_ has joined #openstack-sahara | 18:50 | |
| *** david-ly_ is now known as david-lyle_ | 18:52 | |
| *** tosky has quit IRC | 18:52 | |
| *** david-lyle has quit IRC | 18:54 | |
| *** sgotliv_ has quit IRC | 18:55 | |
| openstackgerrit | Sergey Lukjanov proposed openstack/python-saharaclient: Add releasenotes to sahara client https://review.openstack.org/254908 | 18:57 |
| elmiko | SergeyLukjanov: have you checked this out, https://review.openstack.org/#/c/226157/ | 18:58 |
| SergeyLukjanov | elmiko, it's on my list | 19:00 |
| SergeyLukjanov | elmiko, hi | 19:00 |
| SergeyLukjanov | how are you? | 19:00 |
| elmiko | SergeyLukjanov: hi, doing well. how about you? | 19:01 |
| SergeyLukjanov | seems like recovered from jet lag and switched to the whole day meetings ;) | 19:01 |
| elmiko | \o/ | 19:01 |
| SergeyLukjanov | waiting for the next summit ;) | 19:01 |
| elmiko | haha | 19:01 |
| *** openstackgerrit has quit IRC | 19:02 | |
| elmiko | are you back in Saratov now, or California? | 19:02 |
| *** openstackgerrit has joined #openstack-sahara | 19:03 | |
| *** Akanksha08 has quit IRC | 19:05 | |
| SergeyLukjanov | elmiko, CA now, will return back around December 21 | 19:06 |
| elmiko | SergeyLukjanov: very nice, just in time for holidays =) | 19:07 |
| elmiko | also, all the castellan changes have finally made it through global-reqs. improved secret store is passing all CI \o/ | 19:09 |
| SergeyLukjanov | elmiko, awesome! | 19:13 |
| SergeyLukjanov | I should return back to reviews by the EOW | 19:13 |
| *** david-lyle_ is now known as david-lyle | 19:14 | |
| *** hdd has joined #openstack-sahara | 19:14 | |
| elmiko | SergeyLukjanov: cool, hope the all day meetings aren't too boring ;) | 19:15 |
| *** crobertsrh1 has joined #openstack-sahara | 19:33 | |
| *** sgotliv_ has joined #openstack-sahara | 19:34 | |
| *** crobertsrh1 has quit IRC | 19:50 | |
| *** crobertsrh1 has joined #openstack-sahara | 19:51 | |
| *** vgridnev has quit IRC | 19:56 | |
| *** vgridnev has joined #openstack-sahara | 20:02 | |
| openstackgerrit | Merged openstack/sahara: Updated from global requirements https://review.openstack.org/254480 | 20:06 |
| egafford | Anyone maintaining a mental set of which plugins support provisioning from clean (OS-only) images? | 20:18 |
| egafford | SergeyLukjanov, vgridnev: Either of you might know this off the top of your head. I know HDP does. | 20:19 |
| vgridnev | egafford, probably CDH can do this | 20:20 |
| egafford | vgridnev: Yeah, I think those might be the two. | 20:20 |
| egafford | vgridnev: If I do crazy image validation things, would it be better to target ambari (than HDP) on the HWX side? | 20:21 |
| vgridnev | also ambari can be extended to so (images have only ambari installed) | 20:21 |
| egafford | As I understand it, we're not really supporting HDP anymore as of M, and going all-in on ambari. | 20:22 |
| egafford | vgridnev: I think I'll end up doing that as part of my about-to-be-posted spec. :) | 20:22 |
| vgridnev | for vanilla answer is no. | 20:23 |
| egafford | vgridnev: Yup. Spark too I think. | 20:23 |
| egafford | Not sure about MapR. | 20:23 |
| vgridnev | actually I need to bring mapr folks to these chats | 20:24 |
| egafford | Yeah, me too. | 20:24 |
| vgridnev | egafford, I've got one clarification from mapr folks. This plugin also can use almost clean images, but you need to be sure that mapr repos presented on image | 20:39 |
| egafford | vgridnev: Okay, so not really quite clean. | 20:40 |
| egafford | vgridnev: Thanks. | 20:40 |
| vgridnev | little addition, plain images can be used for mapr | 21:03 |
| vgridnev | egafford, ^^ | 21:03 |
| egafford | vgridnev: Cool! | 21:04 |
| openstackgerrit | Ethan Gafford proposed openstack/sahara-specs: SPI Method to Validate Images https://review.openstack.org/254956 | 21:06 |
| *** akuznetsov has joined #openstack-sahara | 21:09 | |
| *** akuznetsov has quit IRC | 21:14 | |
| openstackgerrit | Ethan Gafford proposed openstack/sahara-specs: SPI Method to Validate Images https://review.openstack.org/254956 | 21:36 |
| *** sgotliv_ has quit IRC | 22:00 | |
| *** crobertsrh1 has quit IRC | 22:09 | |
| *** david-ly_ has joined #openstack-sahara | 22:10 | |
| *** david-lyle has quit IRC | 22:13 | |
| *** david-ly_ is now known as david-lyle | 22:13 | |
| *** ViswaV has quit IRC | 22:18 | |
| *** ViswaV has joined #openstack-sahara | 22:20 | |
| vgridnev | elmiko, are you around? | 22:22 |
| vgridnev | I have one question about improved secret storage implementation. I'm just wonder for which purpose we are passing context object for almost all operations (get, store, so on..) | 22:24 |
| *** witlessb has quit IRC | 22:28 | |
| elmiko | vgridnev: hey | 22:29 |
| elmiko | castellan requires the context object to get an auth for barbicanclient | 22:30 |
| elmiko | in the case of the sahara key manager it isn't used | 22:30 |
| elmiko | if you are curious, here is the abc for the KeyManager https://github.com/openstack/castellan/blob/master/castellan/key_manager/key_manager.py | 22:31 |
| vgridnev | Also there is a nit that I would to suggest. I'm seeing combination of lines "key_manager.API().get(context, pass) \n key.get_encoded()" again and again. Do we want to have some utils for operating with secrets? | 22:35 |
| vgridnev | elmiko, ^^ | 22:37 |
| elmiko | vgridnev: possibly, i think that makes a certain amount of sense | 22:41 |
| elmiko | it's probably a little verbose the way it's written | 22:42 |
| elmiko | alternatively, i could just write it as password=key_manage.API().get(context, pass).get_encoded() | 22:44 |
| elmiko | vgridnev: is that any better? | 22:44 |
| vgridnev | not sure it will fit into 79 chars. | 22:49 |
| vgridnev | But, I need to replace my +1 with +2, I think. Just probably future steps for refactoring | 22:50 |
| elmiko | good point | 22:50 |
| elmiko | ok, i'm fine with refactoring it now if you'd like. i tried to keep it explicit so that folks would understand how it works. | 22:51 |
| *** chlong has quit IRC | 23:10 | |
| openstackgerrit | Merged openstack/sahara-specs: Allow 'is_public' to be set on protected resources https://review.openstack.org/246007 | 23:13 |
| openstackgerrit | Merged openstack/sahara: Adds nosec to system call in NetcatSocket._terminate https://review.openstack.org/254277 | 23:16 |
| *** tmckay has quit IRC | 23:34 | |
| *** ViswaV_ has joined #openstack-sahara | 23:50 | |
| *** ViswaV has quit IRC | 23:51 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!