*** witlessb has quit IRC | 00:09 | |
*** _crobertsrh has quit IRC | 00:49 | |
*** crobertsrh has joined #openstack-sahara | 00:51 | |
*** ErikB2 has joined #openstack-sahara | 00:52 | |
*** alazarev has quit IRC | 00:54 | |
*** ErikB1 has quit IRC | 00:56 | |
*** alazarev has joined #openstack-sahara | 01:01 | |
*** ErikB2 has quit IRC | 01:09 | |
*** alazarev has quit IRC | 02:55 | |
*** witlessb has joined #openstack-sahara | 02:56 | |
*** witlessb has quit IRC | 02:56 | |
*** alazarev has joined #openstack-sahara | 03:29 | |
*** alazarev has quit IRC | 03:40 | |
*** alazarev has joined #openstack-sahara | 03:56 | |
*** alazarev has quit IRC | 04:24 | |
*** Ch00k has joined #openstack-sahara | 05:46 | |
*** alazarev has joined #openstack-sahara | 05:56 | |
*** Ch00k has quit IRC | 05:58 | |
*** Ch00k has joined #openstack-sahara | 05:58 | |
*** Ch00k has quit IRC | 06:07 | |
*** Ch00k has joined #openstack-sahara | 06:08 | |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara-dashboard: Update .gitreview to point on updated repo https://review.openstack.org/79929 | 06:11 |
---|---|---|
*** Ch00k has quit IRC | 06:31 | |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara-dashboard: Make dashboard able to be used as Sahara https://review.openstack.org/80185 | 06:34 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara-dashboard: Make dashboard able to be used as Sahara https://review.openstack.org/80185 | 06:37 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara-dashboard: Rename dashboard slug to sahara https://review.openstack.org/80189 | 06:48 |
openstackgerrit | A change was merged to openstack/sahara-dashboard: Renaming savannadashboard directory to saharadashboard https://review.openstack.org/79746 | 06:51 |
openstackgerrit | A change was merged to openstack/sahara-dashboard: Changing "Savanna" to "Sahara" in basic strings https://review.openstack.org/80079 | 06:51 |
openstackgerrit | A change was merged to openstack/sahara-image-elements: Update .gitreview to point on updated repo https://review.openstack.org/79930 | 06:51 |
*** alazarev has quit IRC | 07:01 | |
openstackgerrit | A change was merged to openstack/sahara-dashboard: Update .gitreview to point on updated repo https://review.openstack.org/79929 | 07:10 |
openstackgerrit | A change was merged to openstack/sahara-dashboard: Rename dashboard slug to sahara https://review.openstack.org/80189 | 07:39 |
*** witlessb has joined #openstack-sahara | 08:24 | |
*** dmitryme has joined #openstack-sahara | 08:41 | |
openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara-image-elements: Update hadoop in vanilla plugin to 2.3 version https://review.openstack.org/80234 | 10:19 |
*** tosky has joined #openstack-sahara | 10:54 | |
openstackgerrit | A change was merged to openstack/sahara-extra: Update .gitreview to point on updated repo https://review.openstack.org/79931 | 11:02 |
*** themistymay has joined #openstack-sahara | 11:06 | |
openstackgerrit | A change was merged to openstack/sahara-image-elements: Update hadoop in vanilla plugin to 2.3 version https://review.openstack.org/80234 | 11:12 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara-image-elements: Renaming all Savanna references to Sahara https://review.openstack.org/79419 | 11:27 |
*** Ch00k has joined #openstack-sahara | 11:41 | |
openstackgerrit | A change was merged to openstack/sahara-image-elements: Renaming all Savanna references to Sahara https://review.openstack.org/79419 | 11:42 |
*** tosky has quit IRC | 11:50 | |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara-dashboard: Add support for Django 1.6 https://review.openstack.org/80258 | 12:00 |
*** tosky has joined #openstack-sahara | 12:04 | |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara-dashboard: Add support for Django 1.6 https://review.openstack.org/80264 | 12:18 |
*** ErikB has joined #openstack-sahara | 12:27 | |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara-image-elements: Add ability to use environment variables for image names https://review.openstack.org/77547 | 12:27 |
*** dmitryme has quit IRC | 12:28 | |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara-image-elements: Add ability to use environment variables for image names https://review.openstack.org/77547 | 12:30 |
openstackgerrit | A change was merged to openstack/sahara-dashboard: Add support for Django 1.6 https://review.openstack.org/80264 | 12:32 |
*** Ch00k has quit IRC | 12:48 | |
tosky | last devstack, sahare is deployed but almost every "Create <something>" button gives an error and I see in the logs lines: | 12:51 |
tosky | [Thu Mar 13 12:51:22.193926 2014] [:error] [pid 18014] No reverse found for "horizon:savanna:cluster_templates:upload_file": u'savanna' is not a registered namespace inside 'horizon' | 12:51 |
tosky | is there some pending patch on gerrit that I can use in the meantime? | 12:52 |
SergeyLukjanov | tosky, yup | 12:52 |
SergeyLukjanov | ot's on review | 12:52 |
SergeyLukjanov | and we'll merge it soon I hope | 12:52 |
SergeyLukjanov | now checking | 12:52 |
SergeyLukjanov | tosky, ^^ | 12:52 |
tosky | SergeyLukjanov: thanks! (no rush, just to have something working in the meantime) | 12:53 |
*** dmitryme has joined #openstack-sahara | 12:54 | |
*** Ch00k has joined #openstack-sahara | 12:58 | |
*** Ch00k has quit IRC | 13:00 | |
*** Ch00k has joined #openstack-sahara | 13:01 | |
*** tmckay has joined #openstack-sahara | 13:06 | |
openstackgerrit | Nikita Konovalov proposed a change to openstack/sahara-dashboard: Rename namespace to match new dashboard slug https://review.openstack.org/80257 | 13:13 |
tosky | oh, THAT patch | 13:14 |
* tosky tries | 13:14 | |
*** Ch00k has quit IRC | 13:18 | |
*** Ch00k has joined #openstack-sahara | 13:23 | |
*** themistymay has quit IRC | 13:32 | |
*** ErikB has quit IRC | 13:41 | |
*** ErikB has joined #openstack-sahara | 13:58 | |
*** elmiko has joined #openstack-sahara | 14:12 | |
elmiko | tmckay, i'm looking at the edp constants thing again, and i'm curious about how wide ranging these constants should be. for example should i use a constant in savanna/db/migration/alembic_migrations/versions/004_jar_to_mapreduce.py@32 ? | 14:13 |
tmckay | elmiko, no, I wouldn't bother with the alembic scripts. Those are special cases, not really any code maintenance there. Once written, they exist forever unchanged. | 14:23 |
elmiko | tmckay, kk | 14:23 |
tmckay | elmiko, the concern is more mainline code, stuff that's going to be modified or added to. | 14:23 |
elmiko | tmckay, got it | 14:24 |
*** alazarev has joined #openstack-sahara | 14:29 | |
*** ErikB has quit IRC | 14:32 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: Fixed reference errors in docs https://review.openstack.org/78789 | 14:48 |
*** ErikB has joined #openstack-sahara | 14:48 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: [IDH] Fixed history server assignment https://review.openstack.org/78875 | 14:48 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change internal variables and classes to 'sahara' https://review.openstack.org/79992 | 14:50 |
*** elmiko_ has joined #openstack-sahara | 14:52 | |
*** Ch00k has quit IRC | 14:59 | |
elmiko_ | tmckay, in the plugins i'm seeing an "info" dict that is bundled into the "cluster" dict, are these using the edp job types? | 15:01 |
elmiko_ | it doesn't look like it, but i want to make sure | 15:02 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Add cli integration test https://review.openstack.org/75527 | 15:02 |
*** elmiko has quit IRC | 15:05 | |
*** elmiko_ is now known as elmiko | 15:06 | |
tmckay | elmiko_, can you point me at a file? | 15:07 |
tmckay | elmiko_, hmm, looks to me like Hadoop services, not job types | 15:07 |
tmckay | elmiko_, we've debated whether or not it's appropriate for the plugins to store configs related to EDP based on job type, but I don't think there is anything there at present (and don't remember if there is an ultimate resolution to that discussion) | 15:07 |
tmckay | elmiko ^^ | 15:07 |
elmiko | tmckay, ok, i'll leave those alone for now | 15:08 |
elmiko | tmckay, i didn't want to start diving into some multilevel dict when it wasn't clear how those values were generated | 15:08 |
tmckay | agreed | 15:08 |
*** alazarev has quit IRC | 15:10 | |
*** _mattf is now known as mattf | 15:24 | |
*** Ch00k has joined #openstack-sahara | 15:35 | |
*** Ch00k has quit IRC | 15:40 | |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change packaging references to python-saharaclient https://review.openstack.org/79979 | 15:47 |
*** sballe has joined #openstack-sahara | 15:48 | |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change internal variables and classes to 'sahara' https://review.openstack.org/79992 | 15:48 |
*** dmitryme has quit IRC | 15:49 | |
*** alazarev has joined #openstack-sahara | 15:49 | |
*** alazarev has quit IRC | 15:50 | |
*** alazarev has joined #openstack-sahara | 15:52 | |
*** themistymay has joined #openstack-sahara | 15:55 | |
*** dmitryme has joined #openstack-sahara | 15:58 | |
openstackgerrit | Alexander Ignatov proposed a change to openstack/sahara: Renamed all swift-dependent configs to sahara https://review.openstack.org/79952 | 16:05 |
tosky | does sahara require neutron for networking, or is it optional? It seems I didn't enable it on devstack and when I try to add a Node Group Templates Sahara complains about a "Floating IP pool public for node group 'master' not found" | 16:14 |
tosky | (the choice is between public and test, same error in both, and I can't seem to find the option to configure them, at least in the UI) | 16:14 |
tmckay | tosky, it's optional. I use "nova", but I think the world is moving toward "neutron". Sooner or later I will have to fix up my configs. | 16:15 |
tmckay | but, nova works for now and does what I need it to do. | 16:15 |
tmckay | tosky, mattf has some experience getting neutron working | 16:15 |
tosky | tmckay: did you configure floating ip in the node group templates, or do you just leave that option blank? | 16:16 |
mattf | mostly blood letting | 16:16 |
tmckay | I have floating ip assignment turned off | 16:16 |
tmckay | So, I would assume I left that option blank | 16:16 |
tmckay | I tend to be a late adopter when my env works for what I need :) | 16:16 |
* mattf was an unfortunate early adopter | 16:17 | |
* tmckay still has 8 tracks (jk) | 16:17 | |
aignatov | tosky: sahara requires neutron only in case of heat engine | 16:17 |
*** ErikB1 has joined #openstack-sahara | 16:17 | |
* mattf isn't happy about ^^ | 16:17 | |
tosky | aignatov: isn't it going to be the default? | 16:17 |
aignatov | yes, it will be by default | 16:18 |
aignatov | actually fix is on the review from SergeyLukjanov | 16:18 |
aignatov | we will merge it after renaming | 16:18 |
tosky | in time for Icehouse I guess | 16:19 |
tosky | ok, I need to start neutron then | 16:19 |
aignatov | tosky: It should work | 16:19 |
aignatov | personally I'm always keep working environment as devstack near to master + neutron + heat engine in sahara | 16:21 |
*** bogdando has quit IRC | 16:22 | |
tosky | thanks, I will try | 16:22 |
aignatov | also I have heat installed on my laptop and linked to the devstack :) | 16:23 |
*** bogdando has joined #openstack-sahara | 16:24 | |
tosky | aignatov: if it is a single-system configuration, do you have any hint to not destoy the main networking of the system? | 16:25 |
tosky | a local.conf would be useful too :) | 16:25 |
*** elmiko has quit IRC | 16:25 | |
aignatov | tosky: I don't have any hints with this | 16:26 |
*** elmiko has joined #openstack-sahara | 16:27 | |
tmckay | aignatov, have you looked at alembic stuff for "savanna/sahara" in URLs? I can work on that... | 16:40 |
tmckay | Maybe I should add the bp to my commits now that the launchpad stuff is moved... | 16:40 |
tmckay | be back soon... | 16:41 |
ErikB | aignatov, do you have plans to change SAVANNA_USE_NEUTRON config setting name to SAHARA_USE_NEUTRON? | 16:41 |
aignatov | tmckay: yes, I've started doing this.... but after small conversation with SergeyLukjanov we decided to postpone this to today's meeting | 16:42 |
SergeyLukjanov | yup, we should discuss backward compat on meeting today | 16:43 |
aignatov | tmckay: the question is global question - to keep or not backward compat? | 16:43 |
aignatov | ErikB: you mean in dashboard? | 16:44 |
mattf | SergeyLukjanov, noticed no activity on https://review.openstack.org/#/c/79766/ ? | 16:54 |
mattf | just waiting for it to come up again next week? | 16:55 |
aignatov | tosky: http://paste.openstack.org/show/73425/ | 16:55 |
tosky | aignatov: oh, thanks | 16:56 |
SergeyLukjanov | mattf, folks are waiting for feedback from ttx I think | 16:59 |
mattf | ahh | 16:59 |
mattf | i thought it was going to be +1's and ttx would help guide the timing for the merge | 16:59 |
mattf | i'm a fan of getting the buyin sooner rather than later, even if the actual event happens later | 17:00 |
ErikB | aignatov, yes | 17:01 |
ErikB | aignatov, when do you think? determining whether or not I should make the doc change now or hold off. | 17:03 |
*** dmitryme has quit IRC | 17:04 | |
tmckay | is our meeting now? | 17:05 |
*** jspeidel has joined #openstack-sahara | 17:05 | |
mattf | tmckay, 1 hour on my calendar...dst | 17:05 |
crobertsrh | tmckay: I think 2:00 today (time change for us) | 17:05 |
tmckay | doh | 17:06 |
jspeidel | got here late, are we scheduled for now or an hour from now? | 17:08 |
jspeidel | I guess that the silence answers my question | 17:09 |
tmckay | jspeidel, an hour from now | 17:09 |
mattf | 1 hr, dst strikes again | 17:09 |
tmckay | I missed dst | 17:09 |
tmckay | can't we just leave nature alone? | 17:10 |
tosky | can't we agree on the same day worldwide? | 17:11 |
tmckay | tosky, sure, we just need enough sleeping pills and stimulants to get everyone on the same schedule | 17:11 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change the enduser facing apects of the shell https://review.openstack.org/79665 | 17:16 |
*** sballe has quit IRC | 17:24 | |
*** sballe has joined #openstack-sahara | 17:25 | |
elmiko | tmckay, looking at savanna/tests/unit/utils/test_edp.py i'm curious if we should keep the local MAPRED_STREAMING variable or use the new job type constant to test against? | 17:26 |
tmckay | elmiko, I'd use the new one | 17:27 |
elmiko | tmckay, k thanks | 17:27 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Swap the saharaclient and savannaclient directories https://review.openstack.org/79751 | 17:38 |
*** jspeidel has left #openstack-sahara | 17:40 | |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change packaging references to python-saharaclient https://review.openstack.org/79979 | 17:41 |
*** sballe has quit IRC | 17:42 | |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change packaging references to python-saharaclient https://review.openstack.org/79979 | 17:44 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change internal variables and classes to 'sahara' https://review.openstack.org/79992 | 17:44 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change internal variables and classes to 'sahara' https://review.openstack.org/79992 | 17:46 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change client doc references to sahara https://review.openstack.org/79803 | 17:48 |
*** themistymay has quit IRC | 17:48 | |
*** sreshetnyak has joined #openstack-sahara | 17:50 | |
openstackgerrit | Erik Bergenholtz proposed a change to openstack/sahara: Renames all doc references from Savanna to Sahara. https://review.openstack.org/80069 | 17:53 |
*** ErikB1 has left #openstack-sahara | 17:57 | |
tmckay | hoping that's the end of it :) | 17:57 |
tmckay | the new "paste the change" activity seems to be delayed | 17:57 |
tmckay | that used to happen almost immediately | 17:57 |
*** dmitryme has joined #openstack-sahara | 17:57 | |
*** ErikB has quit IRC | 17:59 | |
*** ErikB2 has joined #openstack-sahara | 18:02 | |
ErikB2 | Hi | 18:02 |
elmiko | hi | 18:03 |
SergeyLukjanov | o/ | 18:03 |
SergeyLukjanov | meeting | 18:03 |
*** sreshetnyak has quit IRC | 18:04 | |
*** sreshetnyak has joined #openstack-sahara | 18:04 | |
*** sreshetnyak has quit IRC | 18:06 | |
*** sreshetnyak has joined #openstack-sahara | 18:06 | |
*** sreshetnyak has quit IRC | 18:15 | |
*** sreshetnyak has joined #openstack-sahara | 18:15 | |
*** sreshetnyak has quit IRC | 18:22 | |
*** sreshetnyak has joined #openstack-sahara | 18:23 | |
openstackgerrit | Chad Roberts proposed a change to openstack/sahara-dashboard: Renaming internal variables away from savanna https://review.openstack.org/80360 | 18:25 |
*** sreshetnyak has quit IRC | 18:26 | |
*** sreshetnyak has joined #openstack-sahara | 18:27 | |
*** rhodgin has joined #openstack-sahara | 18:28 | |
*** sreshetnyak has quit IRC | 18:30 | |
*** sreshetnyak has joined #openstack-sahara | 18:30 | |
*** Ch00k has joined #openstack-sahara | 18:41 | |
openstackgerrit | Chad Roberts proposed a change to openstack/sahara-dashboard: Renaming internal variables away from savanna https://review.openstack.org/80360 | 18:58 |
aignatov | tmckay: so after voting you could do just s/savanna/sahara/ on all sources :) | 19:00 |
tmckay | yeah, I guess so | 19:01 |
*** sreshetnyak has quit IRC | 19:01 | |
aignatov | and check if sahara-api starts successfully | 19:01 |
SergeyLukjanov | aignatov, we need backward compat for client for transition in tempest | 19:02 |
aignatov | SergeyLukjanov: I'm just kidding | 19:02 |
aignatov | actually I'd prefer to make main savanna code renaming in partitioning manner | 19:03 |
aignatov | a good backlog is in the blueprint which is created by mattf | 19:04 |
*** mattf is now known as _mattf | 19:04 | |
*** tosky has quit IRC | 19:08 | |
*** tnovacik has quit IRC | 19:08 | |
tmckay | SergeyLukjanov, aignatov, okay, does the vote result mean that we don't need savannaclient? Or do we still need it to transition through the gate? | 19:11 |
SergeyLukjanov | tmckay, we still need it | 19:11 |
SergeyLukjanov | tmckay, for transition | 19:11 |
*** elmiko_ has joined #openstack-sahara | 19:11 | |
tmckay | okay | 19:11 |
*** elmiko has quit IRC | 19:12 | |
*** elmiko_ is now known as elmiko | 19:13 | |
aignatov | I think we also need it for those who wants to run savanna 0.3 | 19:13 |
tmckay | okay, I think then I don't need to change anything. | 19:14 |
SergeyLukjanov | tmckay, ut we can swap dirs already | 19:14 |
tmckay | yay! | 19:14 |
*** rhodgin has quit IRC | 19:20 | |
elmiko | what is the best practice for inviting reviewers to a new review? | 19:21 |
elmiko | (e.g. should i invite sahara-core?) | 19:21 |
aignatov | elmiko: first, add him to the review | 19:23 |
elmiko | aignatov: him who, sahara-core? | 19:23 |
aignatov | yes | 19:24 |
elmiko | ok | 19:24 |
aignatov | and then if you think that you are waiting to long for review from him.. | 19:24 |
aignatov | ping him, touch and shout | 19:24 |
elmiko | lol | 19:24 |
elmiko | thanks for the advice :) | 19:25 |
aignatov | elmiko: welcome! | 19:25 |
aignatov | but as for you change you've submitted recently... | 19:27 |
aignatov | not sure if we plan to add this for the icehouse because of feature freeze | 19:28 |
elmiko | so it might be waiting awhile... ? | 19:28 |
aignatov | elmiko: yes, to point when master js opened for juno | 19:30 |
aignatov | *is | 19:30 |
elmiko | ok, good to know | 19:31 |
*** alazarev has quit IRC | 19:31 | |
elmiko | what else can i help with in the meantime before icehouse opens for new features? | 19:34 |
SergeyLukjanov | tmckay, could you please update your patch XXX to keep temp compat for savannaclient.api.base? | 19:35 |
SergeyLukjanov | otherwise it breaks dashboard | 19:35 |
SergeyLukjanov | http://logs.openstack.org/51/79751/4/check/check-tempest-dsvm-sahara-full/874f72a/logs/horizon_error.txt.gz | 19:35 |
SergeyLukjanov | https://review.openstack.org/#/c/79751/4 | 19:35 |
SergeyLukjanov | re https://review.openstack.org/#/c/79751/ | 19:36 |
tmckay | SergeyLukjanov, okay, sure | 19:40 |
SergeyLukjanov | tmckay, thank you | 19:40 |
tmckay | elmiko, have you practiced launching a cluster and running jobs yet? | 19:40 |
elmiko | tmckay, not all the way to jobs. good suggestion | 19:41 |
tmckay | elmiko, it might be a good time to learn :) | 19:41 |
elmiko | definitely :) | 19:41 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/sahara: We're now using nove client >= 2.17.0 https://review.openstack.org/79442 | 19:44 |
*** alazarev has joined #openstack-sahara | 19:45 | |
elmiko | it would be cool to figure out why stack.sh doesn't start sometimes | 19:45 |
*** alazarev has quit IRC | 19:46 | |
*** alazarev has joined #openstack-sahara | 19:48 | |
*** alazarev has quit IRC | 19:51 | |
elmiko | tmckay, when i register the images with sahara, is the username for the fedora image "fedora" ? | 20:08 |
tmckay | yes | 20:08 |
elmiko | ty | 20:08 |
*** bradd1 has joined #openstack-sahara | 20:09 | |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Swap the saharaclient and savannaclient directories https://review.openstack.org/79751 | 20:12 |
tmckay | SergeyLukjanov, okay, hopefully that works. Quick and dirty | 20:13 |
tmckay | works from the interpreter, anyway :) And I had to suppress pep8 | 20:13 |
*** rhodgin has joined #openstack-sahara | 20:13 | |
tmckay | looked to me like api.base was the only thing touched from the dashboard, none of the other api.blah stuff | 20:15 |
SergeyLukjanov | tmckay, yup, thx | 20:15 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change packaging references to python-saharaclient https://review.openstack.org/79979 | 20:18 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change internal variables and classes to 'sahara' https://review.openstack.org/79992 | 20:18 |
openstackgerrit | A change was merged to openstack/python-saharaclient: Change the enduser facing apects of the shell https://review.openstack.org/79665 | 20:19 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Add cli integration test https://review.openstack.org/75527 | 20:19 |
openstackgerrit | A change was merged to openstack/python-saharaclient: Update .gitreview to point on updated repo https://review.openstack.org/79933 | 20:25 |
*** alazarev has joined #openstack-sahara | 20:28 | |
*** dmitryme has quit IRC | 20:31 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: [IDH] Initial documentation for IDH plugin https://review.openstack.org/78779 | 20:34 |
*** tmckay is now known as tmckay_bbl | 20:39 | |
*** Ch00k has quit IRC | 21:00 | |
*** crobertsrh is now known as _crobertsrh | 21:08 | |
*** tmckay_bbl has quit IRC | 21:09 | |
openstackgerrit | A change was merged to openstack/python-saharaclient: Change client doc references to sahara https://review.openstack.org/79803 | 21:12 |
*** tmckay has joined #openstack-sahara | 21:13 | |
elmiko | tmckay, i think i've finally broken my stack :( | 21:16 |
tmckay | yay | 21:16 |
elmiko | tmckay, i did a 'nova keypair-add' and i think i must have fudged it | 21:17 |
tmckay | hmm. that doesn't seem too dangerous | 21:17 |
elmiko | actually it was, 'nova keypair-add stack --pub-key=$HOME/.ssh/id_rsa.pub' was that bad? | 21:17 |
tmckay | oh, do you get weird errors now from nova? | 21:18 |
elmiko | well i tried to create a cluster through the sahara api and it rejected it, saying Authentication required | 21:18 |
elmiko | but when i go to the web interface, now i'm getting all sorts of django errors | 21:18 |
tmckay | hmm. what does nova keypair-list give you? | 21:19 |
elmiko | it shows stack and a fingerprint for it | 21:19 |
elmiko | in horizon i switched to the admin project, then tried to switch back to demo, now it won't let me do anything in horizon | 21:20 |
tmckay | I occasionally get into a place where something is messed up in horizon, I think. if I try to switch from "demo" to "admin" I'm not allowed. Same thing, authentication required. | 21:20 |
elmiko | lol | 21:20 |
tmckay | yeah | 21:20 |
tmckay | elmiko, so I don't know what that is, except frustrating. There is another way... | 21:21 |
elmiko | in the horizon output i see it deleting some token when i switch to admin | 21:21 |
tmckay | elmiko, well, if you can figure that out, it may be valuable. I've ignored it lately and used the client | 21:21 |
elmiko | i had built up everything through cli calls, and i was almost at the cluster create... so close! | 21:22 |
tmckay | You can actually do everything you need to do from the command line. The cli integratoin patch can be kind of a cheat sheet | 21:22 |
elmiko | ok, i'll check it out | 21:22 |
tmckay | elmiko, did you try the cluster launch from the cli? It should work fine | 21:22 |
elmiko | no because it seemed to fail to create the cluster | 21:23 |
elmiko | i got the "Authentication required" when i did the post to /clusters with my json object | 21:23 |
tmckay | Oh, I see. | 21:23 |
elmiko | this was right after i tried to create the stack keypair | 21:23 |
elmiko | did i use the wrong pubkey? | 21:24 |
tmckay | was that through the REST api, or the cli? | 21:24 |
elmiko | rest | 21:24 |
elmiko | using httpie | 21:24 |
elmiko | on a side note, this is really cool stuff :) | 21:25 |
tmckay | ah, okay. You went direct. Any possibility you used the wrong terminal window, and didn't have $TENANT and $TOKEN defined? Did you leave X-Auth-Token:$TOKEN off the end? | 21:25 |
tmckay | if you're at the point of doing everything through REST, I would suggest making friends with the cli. Much simpler | 21:25 |
elmiko | nope, i've been using the little shell-fu script you shared with me, and i made sure to set $TENANT_ID and $AUTH_TOKEN | 21:25 |
elmiko | ok, i'll start to examine the cli. is it best to just restart everything at this point? | 21:26 |
tmckay | well, I'd be tempted. First I would try something simple, like a GET of jobs or something. To see if everything fails. | 21:27 |
elmiko | ok | 21:27 |
elmiko | i got back into the admin console in horizon by signing out and then back in | 21:28 |
elmiko | i can see all my stuff up to the cluster-template, but no cluster | 21:28 |
elmiko | oooh crazy, the console for horizon is complaining about all sorts of Broken Pipe errors | 21:29 |
openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: Renamed 'idh' integration tests to 'idh2' https://review.openstack.org/80405 | 21:29 |
tmckay | elmiko, that sounds bad. I would unstack.sh and shut everything down and restart | 21:30 |
tmckay | dog just walked in with a beachball | 21:30 |
elmiko | take off and nuke the site from orbit? | 21:30 |
tmckay | yeah | 21:30 |
elmiko | lol, big dog? | 21:31 |
tmckay | medium size dog, smallish beachball | 21:31 |
elmiko | nice | 21:31 |
elmiko | we have a great dane, so i have to ask :) | 21:31 |
tmckay | oh, yeah, that's big | 21:31 |
tmckay | This one's about 50lbs | 21:31 |
elmiko | nice | 21:31 |
elmiko | ours is 110lbs which is actually small for a dane | 21:32 |
tmckay | wow | 21:32 |
elmiko | would i use nova or keystone to get a cluster template list? | 21:33 |
tmckay | neither, that's a sahara entity | 21:34 |
elmiko | ahh, ok | 21:34 |
elmiko | i think i hosed my auth somehow, i can't even do a get on $SAHARA_URL/clusters at this point | 21:34 |
tmckay | well, if you want to do forensics as a learning opportunity, you can go poke around in /opt/stack/logs/screen | 21:35 |
tmckay | You might find something in there | 21:35 |
elmiko | ok, i'll check it out | 21:35 |
elmiko | i just did a 'keystone token-get' and my token has changed, is it possible i timed out? | 21:35 |
tmckay | dog looks a lot like this. http://www.examiner.com/article/dalmatian-lab-mix-zeb We don't know what he is, but definitely dalmation and something. | 21:35 |
tmckay | elmiko, possible I suppose | 21:35 |
tmckay | actually, that could be him | 21:36 |
elmiko | aww, cute :) | 21:36 |
elmiko | http://i.imgur.com/rG0OnjO.jpg ours | 21:38 |
elmiko | ok, resetting the token got me back into the rest api | 21:40 |
elmiko | my cluster is setting up | 21:40 |
tmckay | cool | 21:41 |
elmiko | lol, and yea my cpu's are crankin now | 21:41 |
tmckay | my stacks are usually not up that long, commuting back and forth, so I don't think I have tokens expire | 21:41 |
elmiko | and i'm gong back and forth between the command line and online docs, so i might have waited too long from when i first created the auth token | 21:42 |
elmiko | now in the sahara->clusters page my cluster's status is "waiting", is it waiting for work or something else? | 21:43 |
tmckay | waiting for the instance. So, if you go to the "admin" tab and look at instances, you'll see them | 21:44 |
tmckay | They're probably still building or spawning | 21:45 |
elmiko | says they are active and running | 21:45 |
tmckay | If you watch the screen output from you're sahara terminal, you'll see sahara trying to contact those machines. Eventually it will be able to log in, and then it will run shell commands to configure them | 21:45 |
tmckay | okay, you should almost be there | 21:46 |
elmiko | and then do i ssh in to the master node? | 21:46 |
tmckay | Well, you don't have to, but you can. | 21:47 |
elmiko | cool, it let me in! | 21:47 |
tmckay | That's where you can mess around with oozie from the command line | 21:47 |
elmiko | says there were 3 failed logins, i wonder if sahara is having trouble getting in | 21:47 |
tmckay | Alright, you need to ssh with the keyfile that you supplied for the keypair | 21:47 |
tmckay | something like "ssh -i ~/.ssh/id_rsa ubuntu@10.0.3.2" whatever address your master has | 21:48 |
tmckay | that's for an ubuntu image | 21:48 |
tmckay | "fedora" for fedora | 21:49 |
tmckay | and of course the right key file | 21:49 |
elmiko | done and done, it let me in to the command line | 21:49 |
tmckay | nice | 21:49 |
elmiko | horizon says the cluster is "starting" | 21:49 |
tmckay | yeah, it's configuring | 21:49 |
tmckay | on these images, you have sudo | 21:49 |
tmckay | so you can do anything | 21:50 |
elmiko | does it normally take awhile for the cluster to be ready? | 21:50 |
tmckay | Yes | 21:50 |
elmiko | ok, i'll be patient | 21:50 |
tmckay | starting is a good sign | 21:50 |
* elmiko paces back and forth | 21:50 | |
elmiko | nice, cluster is active | 21:52 |
tmckay | okay, now you can try to run a job. So you need data and binaries, and then you need to wrap a job around it | 21:53 |
tmckay | Not sure how thorough the UI doc is... | 21:53 |
elmiko | i'm running a 'hadoop jar hadoop-examples-1.2.1.jar pi 10 100' | 21:54 |
elmiko | seems to be doing "something" | 21:54 |
elmiko | i basically followed the instruction on the quickstart guide | 21:55 |
tmckay | elmiko, cool, you running that from the command line on the node? Or from savanna? | 21:56 |
elmiko | tmckay, command line from the master node | 21:56 |
elmiko | considering i ran it through the node cli, will the job appear in horizon/sahara? | 21:57 |
elmiko | nice, it worked | 21:59 |
elmiko | boy, all that and it rounded pi to the 3rd decimal place... ;) | 22:00 |
tmckay | no, you won't see it in Oozie or savanna. | 22:01 |
tmckay | If you look in the sahara-extra project under the edp examples, there is a wordcount job in there and instructions on running it from oozie on the node | 22:01 |
elmiko | ok, thanks | 22:01 |
openstackgerrit | A change was merged to openstack/sahara: Fixed typo in rollback function description https://review.openstack.org/79122 | 22:02 |
elmiko | i take it i should also become more familiar with python-saharaclient as well at this point | 22:02 |
tmckay | So you have 3 choices to run a job -- hadoop cli, oozie cli (which requires a workflow.xml and a job properties) file, and savanna which wraps oozie (which wraps hadoop) | 22:02 |
tmckay | yes | 22:02 |
elmiko | thanks again for the help, i've got a lot of reading to do here lol | 22:03 |
tmckay | np | 22:03 |
elmiko | when i unstack.sh it will delete all the clusters/nodes ? | 22:06 |
openstackgerrit | A change was merged to openstack/sahara: Cleanup openstack-common.conf https://review.openstack.org/79460 | 22:12 |
tmckay | yeah | 22:17 |
*** rhodgin has quit IRC | 22:17 | |
tmckay | bbl | 22:20 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Swap the saharaclient and savannaclient directories https://review.openstack.org/79751 | 22:24 |
*** elmiko has quit IRC | 22:24 | |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change packaging references to python-saharaclient https://review.openstack.org/79979 | 22:24 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Change internal variables and classes to 'sahara' https://review.openstack.org/79992 | 22:25 |
openstackgerrit | Trevor McKay proposed a change to openstack/python-saharaclient: Add cli integration test https://review.openstack.org/75527 | 22:25 |
tmckay | more compat dancing | 22:25 |
* tmckay waits for results | 22:26 | |
*** tmckay is now known as tmckay_bbl | 22:26 | |
*** ErikB2 has quit IRC | 22:46 | |
*** ErikB has joined #openstack-sahara | 22:47 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: Renamed 'idh' integration tests to 'idh2' https://review.openstack.org/80405 | 22:57 |
*** alazarev has quit IRC | 23:02 | |
*** alazarev has joined #openstack-sahara | 23:04 | |
*** ErikB has quit IRC | 23:22 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!