| *** IlyaE has quit IRC | 01:03 | |
| *** bradd1 has joined #openstack-sahara | 01:43 | |
| *** bradd11 has joined #openstack-sahara | 01:44 | |
| *** bradd1 has quit IRC | 01:48 | |
| *** witlessb has joined #openstack-sahara | 01:56 | |
| *** IlyaE has joined #openstack-sahara | 01:57 | |
| *** IlyaE has quit IRC | 02:22 | |
| *** zhiyan_ is now known as zhiyan | 02:30 | |
| *** IlyaE has joined #openstack-sahara | 02:45 | |
| *** bradd11 has quit IRC | 03:06 | |
| *** IlyaE has quit IRC | 03:17 | |
| *** IlyaE has joined #openstack-sahara | 04:21 | |
| *** akuznetsov has joined #openstack-sahara | 04:36 | |
| *** akuznetsov has quit IRC | 05:08 | |
| *** akuznetsov has joined #openstack-sahara | 05:12 | |
| *** akuznetsov has quit IRC | 05:26 | |
| *** akuznetsov has joined #openstack-sahara | 05:28 | |
| *** Ch00k has joined #openstack-sahara | 05:32 | |
| *** akuznetsov has quit IRC | 05:34 | |
| *** akuznetsov has joined #openstack-sahara | 05:36 | |
| *** akuznetsov has quit IRC | 05:43 | |
| *** akuznetsov has joined #openstack-sahara | 05:49 | |
| *** akuznetsov has joined #openstack-sahara | 05:51 | |
| *** IlyaE has quit IRC | 05:58 | |
| *** akuznetsov has quit IRC | 06:01 | |
| *** Ch00k has quit IRC | 06:32 | |
| *** Ch00k has joined #openstack-sahara | 07:45 | |
| *** witlessb has joined #openstack-sahara | 07:58 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara: Rework keystone auth_token middleware configs https://review.openstack.org/74688 | 08:36 |
|---|---|---|
| *** tosky has joined #openstack-sahara | 08:57 | |
| openstackgerrit | Daniele Venzano proposed a change to openstack/sahara-image-elements: Better setup for custom Java installation https://review.openstack.org/89515 | 09:09 |
| *** akuznetsov has joined #openstack-sahara | 09:14 | |
| *** Ch00k has quit IRC | 09:19 | |
| *** Ch00k has joined #openstack-sahara | 09:20 | |
| openstackgerrit | A change was merged to openstack/sahara: Improved validation for data-sources creation https://review.openstack.org/88092 | 09:44 |
| openstackgerrit | A change was merged to openstack/sahara: Fixed validation of novanetwork w/o autoassignment https://review.openstack.org/87988 | 09:44 |
| openstackgerrit | Sergey Kolekonov proposed a change to openstack/sahara-image-elements: Default Hive version was updated https://review.openstack.org/89524 | 09:53 |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara-image-elements: Add support various oozie version for vanilla images https://review.openstack.org/87723 | 11:47 |
| *** tosky has quit IRC | 11:51 | |
| *** _mattf is now known as mattf | 12:14 | |
| mattf | NikitaKonovalov, ping - are you able to attend the horizon meeting today (16:00 UTC -- http://www.timeanddate.com/worldclock/fixedtime.html?hour=16&min=0&sec=0) | 12:43 |
| mattf | all - does anyone have a copy of hive 0.11.0 tarball? | 12:55 |
| *** tosky has joined #openstack-sahara | 13:07 | |
| mattf | found one - http://archive.apache.org/dist/hive/hive-0.11.0/ | 13:08 |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara-image-elements: Add support various oozie version for vanilla images https://review.openstack.org/87723 | 13:08 |
| openstackgerrit | Matthew Farrellee proposed a change to openstack/sahara-image-elements: Use archive.apache.org instead of www.apache.org https://review.openstack.org/89561 | 13:13 |
| mattf | SergeyLukjanov, ^^ | 13:13 |
| SergeyLukjanov | mattf, approved, archive.apache.org is the right place, they are storing files for the very long time | 13:16 |
| mattf | hive back to 2010! | 13:17 |
| SergeyLukjanov | :) | 13:17 |
| *** elmiko_ is now known as elmiko | 13:18 | |
| NikitaKonovalov | mattf: Yes, I'll be there | 13:20 |
| mattf | NikitaKonovalov, great! | 13:21 |
| tellesnobrega | SergeyLukjanov: hi, i have a question about oozie, the dependencie of sahara on oozie, is sahara itself or the hadoop plugins that depend on oozie? | 13:22 |
| SergeyLukjanov | tellesnobrega, hey, EDP part is depend on oozie write now, but I think that we'll start making it pluggable, it'll be discussed on summit | 13:23 |
| SergeyLukjanov | tellesnobrega, so, now, you could use EDP only for executing jobs through oozie | 13:23 |
| tellesnobrega | and EDP is the only possible way to execute jobs in sahara? | 13:25 |
| mattf | directly from sahara yes. that is, if you want to use the data sources/job binaries/jobs/job executions. | 13:26 |
| mattf | for those to work sahara requires that the cluster have an oozie service running | 13:26 |
| mattf | you can always skip those things, build node groups, cluster templates and start a cluster that you ssh into and run hadoop/mapred commands on | 13:26 |
| *** tmckay has joined #openstack-sahara | 13:27 | |
| *** Ch00k has quit IRC | 13:31 | |
| tellesnobrega | mattf: i see | 13:34 |
| tellesnobrega | thanks | 13:36 |
| mattf | np! | 13:38 |
| *** mattf is now known as _mattf | 13:38 | |
| openstackgerrit | A change was merged to openstack/sahara-image-elements: Use archive.apache.org instead of www.apache.org https://review.openstack.org/89561 | 13:58 |
| tmckay | SergeyLukjanov, so I wanted to use openstack.common.excutils in the cli integration tests. Are we ready to update from openstack common yet? | 14:03 |
| SergeyLukjanov | tmckay, sure, client always ready, no FF, no RC | 14:06 |
| tmckay | SergeyLukjanov, okay, thank you | 14:06 |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara-image-elements: Add support various hadoop version for vanilla images https://review.openstack.org/88029 | 14:19 |
| tellesnobrega | _crobertsrh: are you there? | 14:20 |
| openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Add cli cluster creation and teardown test https://review.openstack.org/89585 | 14:20 |
| openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Restructure tests directory in preparation for cli integration tests https://review.openstack.org/89360 | 14:24 |
| openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Stub integration tests for vanilla, vanilla2 and hdp plugins https://review.openstack.org/89371 | 14:24 |
| openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Stub integration tests for vanilla, vanilla2 and hdp plugins https://review.openstack.org/89371 | 14:35 |
| *** bradd1 has joined #openstack-sahara | 14:47 | |
| openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Add cli cluster creation and teardown test https://review.openstack.org/89585 | 14:59 |
| *** IlyaE has joined #openstack-sahara | 15:02 | |
| openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Add cli cluster creation and teardown test https://review.openstack.org/89585 | 15:02 |
| tosky | ylobankov: ping ping, error running integration tests (I mentioned it last week) on vanilla | 15:02 |
| openstackgerrit | Yaroslav Lobankov proposed a change to openstack/sahara: [IT] More coverage of EDP in tests https://review.openstack.org/89607 | 15:04 |
| ylobankov | tosky: I will be unavailable for some time. What happened? | 15:06 |
| tosky | ylobankov: oh, do you prefer an email then? Basically I tried to execute | 15:07 |
| tosky | tox -e integration -- vanilla2 | 15:07 |
| tosky | after configuring itest.conf, and I get a failure: | 15:07 |
| ylobankov | tosky: amil | 15:07 |
| tosky | http://www.fpaste.org/95970/79235139/ | 15:07 |
| tosky | oki | 15:07 |
| ylobankov | tosky: ok. I will take a look at that | 15:08 |
| tosky | thanks | 15:09 |
| dmitryme | tosky: from the stack race it could be seen that the cluster entered Error state | 15:09 |
| dmitryme | did you check Sahara logs for the clue? | 15:09 |
| tosky | dmitryme: yes, the problem is that testr is not exactly debug-friendly | 15:09 |
| dmitryme | tosky: but actually you should check Sahara logs, not those of integration tests | 15:10 |
| tosky | right, let me check | 15:10 |
| tosky | sahara tells me about an heat error, and heat... | 15:11 |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara-image-elements: Add support various hadoop version for vanilla images https://review.openstack.org/88029 | 15:13 |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara-image-elements: Add support various hadoop version for vanilla images https://review.openstack.org/88029 | 15:18 |
| *** Hao has joined #openstack-sahara | 15:27 | |
| *** zhiyan is now known as zhiyan_ | 15:50 | |
| ylobankov | tosky: let me see Sahara logs | 15:55 |
| tosky | ylobankov: 72K of compressed bzip, email :) | 15:56 |
| *** IlyaE has quit IRC | 15:56 | |
| ylobankov | tosky: yes, of course :) ylobankov@mirantis.com | 16:01 |
| *** IlyaE has joined #openstack-sahara | 16:01 | |
| ylobankov | tosky: I understand correctly that you use a CentOS image for cluster? | 16:11 |
| tosky | ylobankov: yes, exactly | 16:12 |
| tosky | I could retry with a ubuntu one, in fact | 16:12 |
| ylobankov | please, make an attempt | 16:16 |
| *** _mattf is now known as mattf | 16:21 | |
| ylobankov | tosky: I have no ideas what happend. I will ask other engineers about that | 16:22 |
| tosky | ylobankov: I'm trying with ubuntu vanilla in the meantime | 16:22 |
| ylobankov | tosky: let me know which version of Heat do you use? | 16:25 |
| tosky | ylobankov: when I tested on Fedora 20, it was the latest from milestone-proposed; the last test on RHEL (the logs I sent you) is from master (complete fresh installation from master | 16:30 |
| *** bob_nettleton has joined #openstack-sahara | 16:33 | |
| tosky | uhm | 16:35 |
| mattf | bob_nettleton, hello! | 16:35 |
| mattf | skolekonov, apologies for not seeing your hive update this morning. did you test hive 0.13.0 and validate it works? | 16:42 |
| bob_nettleton | mattf, Hi | 16:42 |
| mattf | bob_nettleton, howdy, just sayin' hi | 16:42 |
| *** shakamunyi has joined #openstack-sahara | 16:42 | |
| bob_nettleton | elmiko, thanks for submitting that DIB patch. It will definitely simplify things a bit, since I won't have to use an older DIB just to build the HDP images. | 16:43 |
| elmiko | bob_nettleton: cool :) | 16:45 |
| mattf | bob_nettleton, elmiko, review url? | 16:45 |
| elmiko | https://review.openstack.org/#/c/89386/ | 16:46 |
| elmiko | bob_nettleton: bnemec did have a good question though, why aren't we using the "base" element when creating the CentOS images? | 16:47 |
| tosky | ylobankov: so, it seems it was (of course) a configuration error on my side, shame on me; I was hit again by the "check the flavor you use" issue; sorry again and thanks for the help | 16:53 |
| SergeyLukjanov | #action croberts to add doc re testing his changes for merging sahara-dashboard into the horizon | 16:56 |
| SergeyLukjanov | croberts, could you please do it? | 16:56 |
| SergeyLukjanov | (and read the last horizon meeting logs) | 16:56 |
| mattf | i'll email him the notes after the meeting | 16:56 |
| *** elmiko is now known as elmiko_ | 16:56 | |
| SergeyLukjanov | mattf, thx | 16:57 |
| ylobankov | tosky: which flavor did you use? | 16:57 |
| tosky | ylobankov: I didn't change the default one, "2", which is m1.small and I guess too small for the disk (or too much RAM needed) | 16:58 |
| ylobankov | tosky: I used this flavor and everything was OK | 16:59 |
| tosky | ylobankov: maybe the VMs I generated are too big | 17:00 |
| tosky | truth is that the cluster is being created now | 17:00 |
| *** Ch00k has joined #openstack-sahara | 17:04 | |
| ylobankov | tosky: if you succeed, let me know | 17:07 |
| openstackgerrit | Alexander Ignatov proposed a change to openstack/sahara: Updated architecture diagram in docs https://review.openstack.org/89647 | 17:07 |
| tosky | ylobankov: now the problem is the networking, so I guess I need to check the configuration; but the test is working better than before | 17:08 |
| tosky | I see those "Can't login to node test-cluster-vanilla-v2-master-node-oo-hs-001 (172.24.4.31), reason error: [Errno 113] No route to host from (pid=16618) _wait_until_accessible /opt/stack/sahara/sahara/service/engine.py:95" | 17:08 |
| tosky | so back to check the configuration again :) | 17:08 |
| ylobankov | tosky: it may happen for some time. It is OK | 17:09 |
| tosky | ylobankov: I can't reach the VM with a direct ssh, and the uptime is 29 minutes | 17:10 |
| tosky | and now the test killed the cluster after 30 minutes | 17:10 |
| tosky | ok, I still think it's a configuration issue on my side | 17:10 |
| tosky | (neutroooooon) | 17:10 |
| bob_nettleton | elmiko, I think that "base | 17:12 |
| ylobankov | tosky: yes, 29 mins is too much. | 17:12 |
| bob_nettleton | elmiko, sorry, I think that the "base" element can't be used in the CentOS case. From what I can tell, this is partly caused by the fact that there isn't a "centos" element. For CentOS images (hdp and vanilla), we use the "rhel" element for configuration, but refer to a CentOS image provided by Mirantis. I'm not entirely sure, but I'll bet that is way base is skipped. | 17:13 |
| ylobankov | tosky: All instances should be available after 4-5 mins | 17:14 |
| ylobankov | tosky: If you cannot reach the VMs after 29 mins, something is wrong :) | 17:16 |
| tosky | ylobankov: yes, it's the network configuration | 17:16 |
| tosky | but definitely now it's better, thanks A LOT | 17:16 |
| ylobankov | I advice you to increase cluster creation timeout to 60 mins | 17:16 |
| tosky | dmitryme: you too, thanks! | 17:16 |
| ylobankov | advise* | 17:17 |
| elmiko_ | bob_nettleton: thanks for the details, sounds like we might need a centos base then? | 17:23 |
| *** elmiko_ is now known as elmiko | 17:24 | |
| tosky | yeah centos base \o/ | 17:24 |
| elmiko | tosky: talking with the diskimage-builder people maybe we can get it straightened out | 17:25 |
| bob_nettleton | elmiko, I think so, but there are some complications involved there. A while back, probably a few months ago, there was a submitted patch to build a CentOS element, but it was rejected. I don't remember all the details, but I believe it had something to do with the fact that a CentOS starter image was not available online at the time, which I think was why Mirantis created their own. If that situation has now chang | 17:30 |
| elmiko | bob_nettleton: i may have, i'm going to try and do some testing with base in place and see how far it gets me | 17:30 |
| tosky | bob_nettleton: maybe it could be fixed on the centos side too | 17:31 |
| tosky | for example RDO has this: http://repos.fedorapeople.org/repos/openstack/guest-images/ | 17:32 |
| elmiko | talking with bnemec, he thinks that we could build these images and include the base element as well as having an offsite image to download | 17:32 |
| *** IlyaE has quit IRC | 17:40 | |
| *** IlyaE has joined #openstack-sahara | 18:02 | |
| *** Hao has quit IRC | 18:12 | |
| *** Hao has joined #openstack-sahara | 18:12 | |
| *** Hao has quit IRC | 18:16 | |
| *** bob_nettleton has quit IRC | 18:20 | |
| *** akuznetsov has quit IRC | 18:21 | |
| mattf | aignatov, SergeyLukjanov, can i get a +A on https://review.openstack.org/#/c/86997/ ? | 18:26 |
| SergeyLukjanov | mattf, /me looking | 18:27 |
| SergeyLukjanov | mattf, approved | 18:27 |
| mattf | danke | 18:27 |
| * mattf remembers that he needs to find out about that extra ci hardware | 18:29 | |
| openstackgerrit | A change was merged to openstack/sahara-image-elements: Idiomatic -d (debug) flag https://review.openstack.org/86997 | 18:29 |
| mattf | SergeyLukjanov, what do you think of the pep8 error on http://logs.openstack.org/03/87003/5/check/gate-sahara-image-elements-pep8/650a0fc/console.html ? | 18:31 |
| mattf | i think it's misfiring and the commit message is fine | 18:31 |
| SergeyLukjanov | mattf, personally, I'd like to see something more informational in commit subject, because I don't know what is the bug 1292614 | 18:32 |
| SergeyLukjanov | mattf, if you don't like commit message checking we could probably discuss it on next meetings | 18:32 |
| mattf | but there's 50 char there and the description is in the body of the commit | 18:33 |
| mattf | happy to rewrite the subject, but i'd ask for a draft from someone other than myself | 18:33 |
| *** tosky has quit IRC | 18:34 | |
| *** bradd1 has quit IRC | 18:45 | |
| *** bradd1 has joined #openstack-sahara | 18:47 | |
| *** Ch00k has quit IRC | 18:47 | |
| *** openstackgerrit has quit IRC | 18:49 | |
| *** openstackgerrit has joined #openstack-sahara | 18:49 | |
| *** Ch00k has joined #openstack-sahara | 18:50 | |
| *** IlyaE has quit IRC | 18:56 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara-dashboard: Formally open Juno dev https://review.openstack.org/89679 | 19:09 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara-image-elements: Formally open Juno dev https://review.openstack.org/89680 | 19:09 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara-extra: Formally open Juno dev https://review.openstack.org/89681 | 19:09 |
| *** tellesnobrega has quit IRC | 19:14 | |
| * mattf makes SergeyLukjanov's quick +a look more legit w/ an extra +1 | 19:16 | |
| *** IlyaE has joined #openstack-sahara | 19:19 | |
| SergeyLukjanov | mattf, thx, it | 19:19 |
| SergeyLukjanov | it's just a patterned version bump | 19:19 |
| *** tellesnobrega has joined #openstack-sahara | 19:20 | |
| SergeyLukjanov | mattf, thx for your comments on design summit sessions, I'll cleanup the descriptions / titles tomorrow, take a look on your comments and prepare draft schedule | 19:20 |
| SergeyLukjanov | I hope I'll be able to do all of it tomorrow | 19:20 |
| mattf | SergeyLukjanov, no rush on my part | 19:21 |
| SergeyLukjanov | mattf, I'd like to have an almost final schedule till the end of week to make participants able to prepare etherpads and materials for this sessions | 19:22 |
| *** Ch00k has quit IRC | 19:23 | |
| mattf | ack | 19:23 |
| *** akuznetsov has joined #openstack-sahara | 19:27 | |
| *** akuznetsov has quit IRC | 19:31 | |
| *** shakamunyi has quit IRC | 19:33 | |
| *** shakamunyi has joined #openstack-sahara | 19:36 | |
| *** IlyaE has quit IRC | 19:38 | |
| openstackgerrit | A change was merged to openstack/sahara-extra: Formally open Juno dev https://review.openstack.org/89681 | 19:53 |
| openstackgerrit | A change was merged to openstack/sahara-image-elements: Formally open Juno dev https://review.openstack.org/89680 | 19:54 |
| openstackgerrit | A change was merged to openstack/sahara-dashboard: Formally open Juno dev https://review.openstack.org/89679 | 19:55 |
| mattf | aignatov, SergeyLukjanov, +A pls https://review.openstack.org/#/c/87000/ | 19:57 |
| SergeyLukjanov | mattf, approved | 19:58 |
| mattf | danke | 19:58 |
| openstackgerrit | A change was merged to openstack/sahara-image-elements: Refactor platform detection code https://review.openstack.org/87000 | 19:59 |
| openstackgerrit | Matthew Farrellee proposed a change to openstack/sahara-image-elements: Detect selinux passwd setting bug https://review.openstack.org/87003 | 20:01 |
| openstackgerrit | Matthew Farrellee proposed a change to openstack/sahara-image-elements: Add -d option to vanilla images https://review.openstack.org/87011 | 20:01 |
| *** IlyaE has joined #openstack-sahara | 20:08 | |
| *** sballe_ has joined #openstack-sahara | 20:19 | |
| *** sballe has quit IRC | 20:23 | |
| *** mattf is now known as _mattf | 20:41 | |
| *** IlyaE has quit IRC | 20:44 | |
| tmckay | hmm, I can't seem to get a Java action with Swift configs to work on hadoop 2.3.0. Something is wrong with the code that passes configs to hadoop, something changed... | 20:54 |
| tmckay | Oozie reports "Missing mandatory configuration option: fs.swift.service.sahara.username" | 20:55 |
| tmckay | I'll try hardwiring it, maybe that will tell me whether it's the oozie config file or the hadoop conf interface that's messed up | 20:55 |
| *** IlyaE has joined #openstack-sahara | 21:16 | |
| elmiko | tmckay: have you ever had an issue with devstack barfing on not being able to import pbr? | 21:16 |
| tmckay | not that I can remember | 21:17 |
| elmiko | this is so weird, it's like uninstalling pbr | 21:17 |
| tmckay | I don't think I've had that particular road bump :) | 21:18 |
| elmiko | le sigh | 21:18 |
| tmckay | time to go, I have to figure out tomorrow why stinkin hadoop 2.3.0 things the swift conigs aren't set for my java action, when they are | 21:20 |
| elmiko | good luck :) | 21:21 |
| tmckay | I don't think many folks have been using Java actions with swift configs :) | 21:21 |
| *** tmckay has quit IRC | 21:25 | |
| *** IlyaE has quit IRC | 21:39 | |
| *** elmiko is now known as elmiko_ | 21:47 | |
| *** sballe_ has quit IRC | 21:59 | |
| *** IlyaE has joined #openstack-sahara | 22:13 | |
| *** IlyaE has quit IRC | 22:38 | |
| *** IlyaE has joined #openstack-sahara | 22:46 | |
| *** witlessb has quit IRC | 23:28 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!