openstackgerrit | lu huichun proposed openstack/sahara: Add Java type edp test in integration test of CDH plugin https://review.openstack.org/143499 | 01:09 |
---|---|---|
*** hdd has quit IRC | 02:48 | |
*** witlessb has joined #openstack-sahara | 02:56 | |
*** witlessb has quit IRC | 03:01 | |
*** Networkn3rd has joined #openstack-sahara | 04:14 | |
*** Poornima has joined #openstack-sahara | 04:23 | |
*** hdd has joined #openstack-sahara | 04:27 | |
*** linqi_ has joined #openstack-sahara | 05:20 | |
*** linqi_ has quit IRC | 05:22 | |
*** Networkn3rd has quit IRC | 05:53 | |
*** hdd has quit IRC | 06:36 | |
*** hdd has joined #openstack-sahara | 06:36 | |
*** hdd has quit IRC | 06:58 | |
*** k4n0 has joined #openstack-sahara | 07:07 | |
*** Longgeek has joined #openstack-sahara | 08:22 | |
*** viktors|afk has quit IRC | 08:34 | |
*** viktors has joined #openstack-sahara | 08:34 | |
*** witlessb has joined #openstack-sahara | 08:36 | |
*** viktors has quit IRC | 08:46 | |
*** viktors has joined #openstack-sahara | 08:46 | |
*** skolekonov has joined #openstack-sahara | 08:53 | |
*** IvanBerezovskiy has joined #openstack-sahara | 10:35 | |
*** Poornima has quit IRC | 11:15 | |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Minor refactoring integration tests https://review.openstack.org/133350 | 11:16 |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: [DO NOT MERGE] Fix for CDH IT https://review.openstack.org/143650 | 11:16 |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: [DO NOT MERGE] Fix for CDH IT https://review.openstack.org/143650 | 11:18 |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: [DO NOT MERGE] Fix for CDH IT https://review.openstack.org/143650 | 11:28 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Added endpoint and utils to work with events https://review.openstack.org/134504 | 11:47 |
openstackgerrit | Andrey Pavlov proposed openstack/sahara-specs: Improvement of Sahara logs https://review.openstack.org/143651 | 11:55 |
openstackgerrit | Merged openstack/sahara: Enable auto security group for vanilla integration tests https://review.openstack.org/135282 | 12:06 |
openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Remove Vanilla 2.3 jobs https://review.openstack.org/143659 | 12:15 |
*** _crobertsrh has quit IRC | 12:24 | |
*** zhiyan has quit IRC | 12:24 | |
*** zigo has quit IRC | 12:24 | |
*** hogepodge has quit IRC | 12:24 | |
*** aignatov has quit IRC | 12:24 | |
*** alazarev has quit IRC | 12:24 | |
*** juice has quit IRC | 12:24 | |
*** IvanBerezovskiy has quit IRC | 12:24 | |
*** Longgeek has quit IRC | 12:24 | |
*** NikitaKonovalov has quit IRC | 12:24 | |
*** ruhe has quit IRC | 12:24 | |
*** clds_ has quit IRC | 12:24 | |
*** egafford has quit IRC | 12:24 | |
*** jodah has quit IRC | 12:24 | |
*** venza has quit IRC | 12:24 | |
*** _crobertsrh has joined #openstack-sahara | 12:25 | |
*** zhiyan has joined #openstack-sahara | 12:26 | |
*** zigo has joined #openstack-sahara | 12:26 | |
*** hogepodge has joined #openstack-sahara | 12:26 | |
*** aignatov has joined #openstack-sahara | 12:26 | |
*** alazarev has joined #openstack-sahara | 12:26 | |
*** juice has joined #openstack-sahara | 12:26 | |
*** IvanBerezovskiy has joined #openstack-sahara | 12:26 | |
*** Longgeek has joined #openstack-sahara | 12:26 | |
*** NikitaKonovalov has joined #openstack-sahara | 12:26 | |
*** ruhe has joined #openstack-sahara | 12:26 | |
*** clds_ has joined #openstack-sahara | 12:26 | |
*** egafford has joined #openstack-sahara | 12:28 | |
*** jodah has joined #openstack-sahara | 12:28 | |
*** venza has joined #openstack-sahara | 12:28 | |
openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding ability to access context from openstack.common.log https://review.openstack.org/143663 | 12:43 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Added endpoint and utils to work with events https://review.openstack.org/134504 | 12:43 |
*** witlessb has quit IRC | 12:56 | |
*** witlessb has joined #openstack-sahara | 12:56 | |
openstackgerrit | Andrey Pavlov proposed openstack/sahara-specs: Adding cluster/instance/job_execution ids to logs https://review.openstack.org/143651 | 13:00 |
openstackgerrit | Andrey Pavlov proposed openstack/sahara-specs: Adding cluster/instance/job_execution ids to logs https://review.openstack.org/143651 | 13:11 |
*** _crobertsrh is now known as crobertsrh | 13:52 | |
*** tmckay has joined #openstack-sahara | 14:09 | |
*** elmiko has quit IRC | 14:13 | |
*** elmiko has joined #openstack-sahara | 14:13 | |
openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding ability to access context from openstack.common.log https://review.openstack.org/143663 | 14:53 |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Minor refactoring integration tests https://review.openstack.org/133350 | 14:59 |
*** k4n0 has quit IRC | 15:25 | |
*** hdd has joined #openstack-sahara | 15:26 | |
openstackgerrit | Andrey Pavlov proposed openstack/sahara-specs: Adding cluster/instance/job_execution ids to logs https://review.openstack.org/143651 | 15:37 |
openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Add saharaclient tempest tests for Sahara https://review.openstack.org/143686 | 15:52 |
*** guo has joined #openstack-sahara | 16:01 | |
openstackgerrit | Merged openstack/sahara: Updated from global requirements https://review.openstack.org/142639 | 16:03 |
*** guo has quit IRC | 16:07 | |
tmckay | oikawa_, hi. Your Java configuration wrapper works with spark-submit and spark jobs as well :) | 16:13 |
tmckay | although, I don't think the security manager wrapper is needed and the file location will need to be determined another way | 16:14 |
tmckay | But, the essential mechanism is the same | 16:14 |
tmckay | SergeyLukjanov, ^^ so it looks from playing around that we can use a very similar wrapper for Spark to set Swift configs. So far I have just printed config values, but I believe it will work | 16:17 |
tmckay | elmiko, ^^ | 16:18 |
tmckay | For spark, I think we just need to generate a tiny xml holding the swift properties (old-style cred or the proxy settings) and put it in the tmp job dir. The swift wrapper will read from that file. | 16:20 |
*** Networkn3rd has joined #openstack-sahara | 16:30 | |
elmiko | tmckay: the idea of having cleartext creds in a file on the servers makes me a little nervous, but maybe we can delete the file after usage or something? | 16:43 |
tmckay | yeah, same thought here. Thinking about it. | 16:44 |
*** hdd has quit IRC | 16:46 | |
*** IvanBerezovskiy has left #openstack-sahara | 16:48 | |
*** skolekonov has quit IRC | 16:50 | |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Minor refactoring integration tests https://review.openstack.org/133350 | 17:16 |
*** openstackgerrit has quit IRC | 17:34 | |
*** openstackgerrit has joined #openstack-sahara | 17:35 | |
*** crobertsrh has quit IRC | 17:56 | |
*** witlessb has quit IRC | 18:35 | |
*** crobertsrh has joined #openstack-sahara | 19:03 | |
*** hdd has joined #openstack-sahara | 19:04 | |
*** egafford has quit IRC | 19:04 | |
SergeyLukjanov | tmckay, that's really cool | 19:17 |
tmckay | SergeyLukjanov, I just got it to work :) Ugly, and we need new Sahara spark images, and some more code .... | 19:33 |
tmckay | But I did it by hand | 19:33 |
tmckay | it is possible :) | 19:33 |
*** witlessb has joined #openstack-sahara | 19:48 | |
*** elmiko_ has joined #openstack-sahara | 19:50 | |
*** elmiko_ is now known as elmiko_lptp | 19:50 | |
elmiko_lptp | SergeyLukjanov: i think CI is asking weird, it keeps running this review even though it has merged. https://review.openstack.org/#/c/142578/ | 20:47 |
*** tmckay has quit IRC | 21:33 | |
*** amcrn has joined #openstack-sahara | 21:41 | |
amcrn | given that storm + zk are now supported in sahara: are there any ongoing conversations around kafka? | 21:43 |
elmiko_lptp | amcrn: i think there have been a few people talking about kafka, but it's been light so far | 21:44 |
amcrn | elmiko_lptp: any idea as to whether that fits into the mission of sahara, or is that unchartered water? | 21:46 |
elmiko_lptp | amcrn: a little uncharted water, but i feel that if kafka is an essential tool for streaming into storm, then we will want to investigate how we can add it to our node group processes | 21:47 |
amcrn | elmiko_lptp: roger that. thanks for the info. i'll start idling in here to keep an eye/ear out for related discussions. | 21:48 |
elmiko_lptp | amcrn: i think there is interest surrounding kafka, but i'm not sure we have agreed on a position in terms of how we should integrate it. | 21:48 |
elmiko_lptp | amcrn: if you have strong ideas about it i would definitely encourage you to attend one of our weekly meetings and bring it, or even propose a blueprint. | 21:49 |
elmiko_lptp | https://wiki.openstack.org/wiki/Meetings/SaharaAgenda | 21:49 |
amcrn | elmiko_lptp: cool, thanks. | 21:50 |
elmiko_lptp | amcrn: i just noticed that page is slightly out of date, we are alternating weeks on our meetings between 1800UTC and 1400UTC to include more folks from differing timezones | 21:51 |
amcrn | elmiko_lptp: noted, cheers. | 21:56 |
*** egafford has joined #openstack-sahara | 21:57 | |
*** crobertsrh has quit IRC | 21:58 | |
*** elmiko_lptp has quit IRC | 22:07 | |
*** hdd has quit IRC | 22:43 | |
*** Longgeek has quit IRC | 22:49 | |
*** Networkn3rd has quit IRC | 22:59 | |
*** egafford has quit IRC | 23:31 | |
*** miqui_ has quit IRC | 23:46 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!