| *** julienvey has joined #openstack-sahara | 00:18 | |
| *** julienvey has quit IRC | 00:23 | |
| *** crobertsrh has left #openstack-sahara | 00:26 | |
| *** Networkn3rd has joined #openstack-sahara | 00:38 | |
| *** Networkn3rd has quit IRC | 01:00 | |
| *** Networkn3rd has joined #openstack-sahara | 01:04 | |
| *** Networkn3rd has quit IRC | 01:12 | |
| *** Krast has quit IRC | 01:17 | |
| *** Krast has joined #openstack-sahara | 01:17 | |
| *** julienvey has joined #openstack-sahara | 01:19 | |
| *** julienvey has quit IRC | 01:24 | |
| *** bradd1 has joined #openstack-sahara | 01:33 | |
| *** _elmiko is now known as elmiko | 01:51 | |
| *** witlessb has joined #openstack-sahara | 01:56 | |
| *** witlessb has quit IRC | 02:01 | |
| *** alazarev has quit IRC | 02:18 | |
| *** alazarev has joined #openstack-sahara | 02:18 | |
| *** alazarev has quit IRC | 02:18 | |
| *** julienvey has joined #openstack-sahara | 02:20 | |
| *** julienvey has quit IRC | 02:25 | |
| *** ViswaV_ has joined #openstack-sahara | 02:59 | |
| *** ViswaV has quit IRC | 03:03 | |
| *** elmiko is now known as _elmiko | 03:16 | |
| *** julienvey has joined #openstack-sahara | 03:21 | |
| *** julienvey has quit IRC | 03:25 | |
| *** ViswaV_ has quit IRC | 03:30 | |
| *** sreshetn1ak has joined #openstack-sahara | 03:52 | |
| *** sreshetnyak has quit IRC | 03:52 | |
| *** julienvey has joined #openstack-sahara | 04:21 | |
| *** julienvey has quit IRC | 04:26 | |
| *** alazarev has joined #openstack-sahara | 04:31 | |
| *** julienvey has joined #openstack-sahara | 05:22 | |
| *** julienvey has quit IRC | 05:27 | |
| *** tnovacik has joined #openstack-sahara | 05:32 | |
| *** alazarev has quit IRC | 05:46 | |
| openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: Add notifications to Sahara https://review.openstack.org/108982 | 05:52 |
|---|---|---|
| openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: Add notifications to Sahara https://review.openstack.org/108982 | 05:54 |
| openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: Add unit test for notify and messaging functions https://review.openstack.org/113840 | 06:02 |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/sahara: Imported Translations from Transifex https://review.openstack.org/114134 | 06:10 |
| *** tnovacik has quit IRC | 06:15 | |
| *** julienvey has joined #openstack-sahara | 06:23 | |
| *** julienvey has quit IRC | 06:28 | |
| *** k4n0 has joined #openstack-sahara | 06:30 | |
| *** ViswaV has joined #openstack-sahara | 06:34 | |
| *** ViswaV has quit IRC | 06:35 | |
| *** tnovacik has joined #openstack-sahara | 07:04 | |
| *** Longgeek has joined #openstack-sahara | 07:13 | |
| *** julienvey has joined #openstack-sahara | 07:24 | |
| *** julienvey has quit IRC | 07:28 | |
| *** skolekonov has joined #openstack-sahara | 07:37 | |
| *** sballe has joined #openstack-sahara | 07:39 | |
| *** Longgeek has quit IRC | 07:46 | |
| *** Longgeek has joined #openstack-sahara | 07:46 | |
| *** Longgeek has quit IRC | 08:00 | |
| *** Longgeek has joined #openstack-sahara | 08:00 | |
| *** Longgeek has quit IRC | 08:04 | |
| *** Longgeek has joined #openstack-sahara | 08:05 | |
| *** tnovacik has quit IRC | 08:19 | |
| *** skolekonov has quit IRC | 08:23 | |
| *** tnovacik has joined #openstack-sahara | 08:24 | |
| *** julienvey has joined #openstack-sahara | 08:24 | |
| *** julienvey has quit IRC | 08:29 | |
| *** witlessb has joined #openstack-sahara | 08:32 | |
| *** sballe_ has joined #openstack-sahara | 09:04 | |
| *** sballe has quit IRC | 09:05 | |
| *** sballe_ has quit IRC | 09:09 | |
| *** tnovacik_ has joined #openstack-sahara | 09:14 | |
| *** tnovacik has quit IRC | 09:14 | |
| *** tnovacik_ is now known as tnovacik | 09:16 | |
| *** sballe has joined #openstack-sahara | 09:18 | |
| *** sballe has quit IRC | 09:24 | |
| *** julienvey has joined #openstack-sahara | 09:25 | |
| *** julienvey has quit IRC | 09:29 | |
| *** julienvey has joined #openstack-sahara | 09:37 | |
| *** tosky has joined #openstack-sahara | 09:44 | |
| openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: [HDP1.3.2] Fixed bug with decommissioning cluster https://review.openstack.org/114187 | 10:10 |
| *** Longgeek has quit IRC | 10:10 | |
| *** Longgeek has joined #openstack-sahara | 10:11 | |
| *** Longgeek has quit IRC | 10:14 | |
| openstackgerrit | A change was merged to openstack/sahara-image-elements: Fixed parameters parsing after -d https://review.openstack.org/113708 | 10:33 |
| *** Longgeek has joined #openstack-sahara | 10:37 | |
| openstackgerrit | A change was merged to openstack/sahara-extra: Remove edp-examples https://review.openstack.org/112625 | 10:42 |
| openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/sahara-ci-config: Remove unused parameter SSH_USERNAME from configs https://review.openstack.org/113262 | 10:58 |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara: Unit tests for CDH plugin https://review.openstack.org/113513 | 11:22 |
| *** sreshetn1ak has quit IRC | 11:31 | |
| *** sreshetnyak has joined #openstack-sahara | 11:31 | |
| *** Krast has quit IRC | 11:31 | |
| *** tosky has quit IRC | 11:45 | |
| *** julienvey has quit IRC | 11:48 | |
| openstackgerrit | A change was merged to openstack/sahara: Updated from global requirements https://review.openstack.org/114074 | 11:54 |
| openstackgerrit | A change was merged to openstack/sahara: Imported Translations from Transifex https://review.openstack.org/114134 | 11:54 |
| openstackgerrit | A change was merged to openstack/sahara: Fix scale up cluster on CDH plugin with vanilla image https://review.openstack.org/112590 | 11:55 |
| *** skolekonov has joined #openstack-sahara | 12:02 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara: Fix parsing dfsreport for CDH in integration tests https://review.openstack.org/112534 | 12:08 |
| *** DenisEgorenko has joined #openstack-sahara | 12:18 | |
| *** tosky has joined #openstack-sahara | 12:22 | |
| *** tnovacik has quit IRC | 12:32 | |
| *** _elmiko is now known as elmiko | 12:34 | |
| openstackgerrit | A change was merged to openstack/sahara: Fixed Exception failures caused by i18n https://review.openstack.org/113196 | 13:05 |
| openstackgerrit | A change was merged to openstack/python-saharaclient: Updated from global requirements https://review.openstack.org/114072 | 13:12 |
| *** sballe has joined #openstack-sahara | 13:24 | |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Adding integration tests for Spark https://review.openstack.org/114243 | 13:26 |
| *** tmckay has joined #openstack-sahara | 13:28 | |
| *** sballe has quit IRC | 13:33 | |
| DenisEgorenko | tmckay: Hello :-) I've added patch for our CI with Spark tests. Can you review it? https://review.openstack.org/#/c/114243/ | 13:35 |
| DenisEgorenko | may be i missed some settings | 13:35 |
| tmckay | DenisEgorenko, okay, great, I was going to ask how to do that :) | 13:36 |
| tmckay | not too familiar with CI setup but I'll take a look | 13:36 |
| tmckay | DenisEgorenko, I should add the spark plugin authors, too | 13:37 |
| DenisEgorenko | i mean, may be some other settings for spark tests must be added to the conf file | 13:38 |
| tmckay | DenisEgorenko, I have experimented with a saharclient test for spark but I haven't added one yet. Does gate-saharaclient-integration-spark refef to a python-saharaclient/saharaclient/tests/integration/tests/test_spark.py? Or a tempest test or something else? | 13:41 |
| DenisEgorenko | tmckay: No, python-saharaclient runs sahara integration tests | 13:47 |
| tmckay | I worked on saharaclient/tests/integration/tests/ but I didn't know they were in ci | 13:49 |
| tmckay | DenisEgorenko, okay, I added a few comments | 13:50 |
| skolekonov | tmckay, hello. gate-saharaclient-integration-spark job just executes the sahara intergration tests, but uses python-saharaclient from the patch which triggered tests. | 13:51 |
| tmckay | ah ah, okay, thank you :) | 13:52 |
| tmckay | That makes sense | 13:53 |
| DenisEgorenko | tmckay: i have one question for you :-) | 13:54 |
| *** sballe has joined #openstack-sahara | 13:54 | |
| *** tosky has quit IRC | 13:55 | |
| DenisEgorenko | tmckay: about spark version :-) | 13:55 |
| tmckay | sure | 13:55 |
| tmckay | DenisEgorenko, ah, okay. There is a HADOOP_VERSION in the conf settings for the test, which I think is passed to the plugin | 13:56 |
| DenisEgorenko | tmckay: What is difference between 1.0.0 and 0.9.2 for tests? | 13:56 |
| DenisEgorenko | tmckay: about hadoop_version. Our variable is just for us :-) for cluster name | 13:57 |
| tmckay | well, the plugin supports 0.9.1, but we are only adding EDP for >= 1.0.0 so I don't think we care too much about 0.9.1 | 13:57 |
| tmckay | If we added a test for 0.9.1, it would be only build cluster/teardown cluster (and scaling when we add it) | 13:58 |
| DenisEgorenko | tmckay: because without 'hadoop_version' variable we have some problem with cluster deleting after test for plugins which support few hadoop versions | 13:59 |
| DenisEgorenko | tmckay: i suppose, that for CI we will use 1.0.0 version. | 13:59 |
| DenisEgorenko | SergeyLukjanov: Are you here? | 14:00 |
| tmckay | DenisEgorenko, makes sense. SergeyLukjanov, do you think we should add a test for spark 0.9.1? I expect most users will use 1.0.0 now that it's available. What do you think? (venza, if you're there) | 14:00 |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Adding integration tests for Spark https://review.openstack.org/114243 | 14:01 |
| *** tosky has joined #openstack-sahara | 14:29 | |
| *** alazarev has joined #openstack-sahara | 14:29 | |
| *** k4n0 has quit IRC | 14:45 | |
| *** tmckay is now known as _tmckay | 14:50 | |
| *** alazarev has quit IRC | 15:17 | |
| SergeyLukjanov | _tmckay, DenisEgorenko, IMO only latest one (1.0.0) | 15:26 |
| *** tnovacik has joined #openstack-sahara | 15:28 | |
| *** alazarev has joined #openstack-sahara | 15:28 | |
| DenisEgorenko | SergeyLukjanov: ok | 15:29 |
| *** sballe_ has joined #openstack-sahara | 15:33 | |
| *** sballe has quit IRC | 15:36 | |
| *** tnovacik has quit IRC | 15:36 | |
| *** tnovacik has joined #openstack-sahara | 15:38 | |
| *** skolekonov has quit IRC | 15:40 | |
| *** skolekonov has joined #openstack-sahara | 15:41 | |
| *** tnovacik has quit IRC | 15:50 | |
| *** _tmckay is now known as tmckay | 15:51 | |
| *** Longgeek has quit IRC | 15:52 | |
| *** skolekonov has quit IRC | 15:55 | |
| *** sballe has joined #openstack-sahara | 16:06 | |
| *** sballe__ has joined #openstack-sahara | 16:07 | |
| *** sballe_ has quit IRC | 16:08 | |
| *** DenisEgorenko has left #openstack-sahara | 16:08 | |
| *** sballe has quit IRC | 16:11 | |
| *** sballe__ has quit IRC | 16:21 | |
| *** sballe has joined #openstack-sahara | 16:55 | |
| *** sballe has quit IRC | 16:56 | |
| *** sballe has joined #openstack-sahara | 16:56 | |
| *** sballe has quit IRC | 16:56 | |
| *** sballe has joined #openstack-sahara | 16:57 | |
| *** tosky has quit IRC | 17:30 | |
| tmckay | SergeyLukjanov, I should be back for the meeting, maybe a few minutes late, I have to run out | 17:40 |
| *** tosky has joined #openstack-sahara | 17:53 | |
| SergeyLukjanov | tmckay, ack | 17:55 |
| SergeyLukjanov | meeting 5 mins | 17:55 |
| *** sballe has quit IRC | 18:08 | |
| alazarev | with broken pig in oozie I think the best solution is custom oozie build | 19:00 |
| aignatov | david-lyle left the chat room. (Remote host closed the connection) | 19:00 |
| aignatov | [10:59pm] alazarev: with broken pig in oozie I think the best solution is custom oozie build | 19:00 |
| aignatov | [10:59pm] tmckay: okay, quick comment on Oozie. Either with Ooozie config settings, or firewall settings, I think we need to block oozie server access to Sahara and cluster nodes | 19:00 |
| aignatov | [10:59pm] elmiko: i have a few concerns about what we will asking operators to change about their keystone configs for the swift/auth stuff. but i will put it an email. | 19:00 |
| aignatov | [10:59pm] Barker joined the chat room. | 19:00 |
| aignatov | [10:59pm] tmckay: so that people cannot spy on jobs, read configs, and thereby get creds and trust tokens | 19:00 |
| aignatov | [11:00pm] SergeyLukjanov: let's continue in our channel | 19:00 |
| aignatov | [11:00pm] SergeyLukjanov: thanks folks | 19:00 |
| aignatov | [11:00pm] tmckay: I am looking in to both -- firewall setup, and oozie configs | 19:00 |
| tmckay | alazarev, I missed broken pig problem. Ooops. What's wrong | 19:01 |
| alazarev | what oozie do we use now for vanilla hadoop2? | 19:01 |
| tmckay | I think 4.0. Not sure. | 19:01 |
| aignatov | alazarev: agree on custom oozie build | 19:01 |
| sreshetnyak | 4.0.1 | 19:01 |
| alazarev | tmckay: I’m talking about https://bugs.launchpad.net/sahara/+bug/1340738 | 19:01 |
| sreshetnyak | vanilla plugin already have a custom oozie build | 19:02 |
| alazarev | I mean where is it hosted? do we download release binary? | 19:02 |
| sreshetnyak | vanilla plugin already have a custom oozie build | 19:02 |
| alazarev | sreshetnyak: do we have repo with changes? or script? or something? | 19:03 |
| sreshetnyak | wrong message, bad touchpad :) | 19:03 |
| tmckay | ah, I see. | 19:03 |
| tmckay | so the question is how DIB gets the oozie install | 19:03 |
| alazarev | tmckay: exactly | 19:03 |
| sreshetnyak | alazarev, do not have | 19:04 |
| tmckay | looks like we grab a tar ball | 19:04 |
| tmckay | from mirantis.com | 19:04 |
| tmckay | so we could make our own and tar it up | 19:04 |
| tmckay | ++ seems good to me | 19:04 |
| alazarev | hm… do we have doc on changes in http://sahara-files.mirantis.com/oozie-juno-4.0.1-hadoop-2.4.1.tar.gz vs release binary? | 19:05 |
| alazarev | who is maintainer of this binary? | 19:06 |
| sreshetnyak | we build oozie with custom requirements (hadoop, pig) | 19:06 |
| sreshetnyak | alazarev, I | 19:06 |
| alazarev | we need to document this somehow, I don’t like that knowledge is hidden | 19:06 |
| sreshetnyak | I would prefer repo on github with custom changes | 19:08 |
| alazarev | yeap, that would work too | 19:08 |
| alazarev | sreshetnyak: could you build new oozie with automaton block from https://git-wip-us.apache.org/repos/asf?p=oozie.git;a=blob_plain;f=pom.xml;hb=branch-4.1 and check that big fixed? | 19:09 |
| alazarev | *bug | 19:09 |
| sreshetnyak | yes | 19:10 |
| alazarev | ok, changing bug assignee to you | 19:10 |
| sreshetnyak | ok :) | 19:12 |
| *** zengyunling__ has joined #openstack-sahara | 19:23 | |
| *** ling-yun-1 has quit IRC | 19:26 | |
| *** miqui has quit IRC | 19:33 | |
| *** alazarev has quit IRC | 19:34 | |
| *** tnovacik has joined #openstack-sahara | 19:36 | |
| *** tmckay is now known as tmckay_bbl | 19:36 | |
| *** miqui has joined #openstack-sahara | 19:40 | |
| *** alazarev has joined #openstack-sahara | 19:57 | |
| *** tnovacik has quit IRC | 20:38 | |
| SergeyLukjanov | folks, I've just released sahara client 0.7.1 | 20:38 |
| elmiko | cool | 20:39 |
| openstackgerrit | Andreas Jaeger proposed a change to openstack/python-saharaclient: Fix duplicate help strings https://review.openstack.org/114355 | 20:56 |
| elmiko | SergeyLukjanov: if we leave backward compat in for swift/auth, then if sahara can't find the proxy domain we could limit the user to only the old method. but this depends on if we want backward compat. | 21:17 |
| *** bradd1 has quit IRC | 21:44 | |
| *** openstackgerrit has quit IRC | 21:46 | |
| *** openstackgerrit has joined #openstack-sahara | 21:47 | |
| *** bandarji has joined #openstack-sahara | 22:00 | |
| *** tosky has quit IRC | 23:10 | |
| *** elmiko is now known as _elmiko | 23:30 | |
| openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: Improved error handling for provisioning operations https://review.openstack.org/104395 | 23:39 |
| openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: Added ability to create security group automatically https://review.openstack.org/109394 | 23:45 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!