| *** witlessb has quit IRC | 00:10 | |
| *** alazarev has quit IRC | 00:36 | |
| tmckay_bbl | yay! jenkins passed. apparently the client is compat enough now :) | 00:38 |
|---|---|---|
| *** openstack has joined #openstack-sahara | 00:50 | |
| *** bradd1 has joined #openstack-sahara | 00:51 | |
| *** alazarev has joined #openstack-sahara | 00:51 | |
| *** openstack has quit IRC | 00:51 | |
| *** openstack has joined #openstack-sahara | 00:52 | |
| *** openstack has quit IRC | 00:52 | |
| *** openstack has joined #openstack-sahara | 00:52 | |
| *** bogdando has joined #openstack-sahara | 00:54 | |
| *** tmckay has joined #openstack-sahara | 00:54 | |
| *** openstack has joined #openstack-sahara | 00:56 | |
| *** openstack has quit IRC | 00:57 | |
| *** openstack has joined #openstack-sahara | 00:58 | |
| *** openstack has joined #openstack-sahara | 01:14 | |
| *** openstack has joined #openstack-sahara | 01:19 | |
| *** openstack has quit IRC | 01:24 | |
| *** openstack has joined #openstack-sahara | 01:25 | |
| *** openstack has joined #openstack-sahara | 15:08 | |
| elmiko | tmckay, cool | 15:16 |
| aignatov | tmckay: great, I think we need to rebase your change on the my latest change | 15:19 |
| openstackgerrit | Alexander Ignatov proposed a change to openstack/sahara: Replaced all Savanna words in class names https://review.openstack.org/80562 | 15:24 |
| openstackgerrit | A change was merged to openstack/sahara: Fixed reference errors in docs https://review.openstack.org/78789 | 15:29 |
| openstackgerrit | A change was merged to openstack/sahara: [IDH] Fixed history server assignment https://review.openstack.org/78875 | 15:29 |
| tmckay | aignatov, okay | 15:30 |
| *** crobertsrh has quit IRC | 15:30 | |
| SergeyLukjanov | tmckay, thx | 15:32 |
| tmckay | aignatov, you mean 80562 above? | 15:33 |
| aignatov | tmckay: I think it's 80589 | 15:34 |
| tmckay | ah, okay | 15:35 |
| aignatov | then I'll rebase on yours and then you again on mine...deeper and deeper | 15:36 |
| tmckay | it sounds terrible | 15:36 |
| *** crobertsrh has joined #openstack-sahara | 15:38 | |
| *** bob_nettleton has joined #openstack-sahara | 15:39 | |
| openstackgerrit | Trevor McKay proposed a change to openstack/sahara: Move the savanna subdir to sahara https://review.openstack.org/80591 | 15:41 |
| tmckay | aignatov, okay :) | 15:41 |
| tmckay | This time I made fixit.sh | 15:41 |
| tmckay | eaiser just to rexecute than it is to deal with conflicts | 15:42 |
| aignatov | tmckay: will it fix all conflicts in the world? ;) | 15:44 |
| tmckay | heh, sadly, no | 15:44 |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara-image-elements: Add oozie for hadoop 2 plugin https://review.openstack.org/80610 | 15:57 |
| *** ErikB1 has quit IRC | 15:58 | |
| tmckay | okay, time for me to go. See you all Monday! | 16:00 |
| elmiko | tmckay, have fun | 16:02 |
| * mattf tries to scrape off the dib gunk | 16:15 | |
| *** bob_nettleton has quit IRC | 16:27 | |
| *** ErikB1 has joined #openstack-sahara | 16:35 | |
| *** tmckay has quit IRC | 16:36 | |
| openstackgerrit | A change was merged to openstack/python-saharaclient: Swap the saharaclient and savannaclient directories https://review.openstack.org/79751 | 16:44 |
| *** Ch00k has quit IRC | 16:46 | |
| mattf | ErikB1, how long should i let the hdp "configure" a cluster before i decide it's just not going to finish? | 16:48 |
| mattf | 1 master, 3 workers, using a pre-populated image | 16:48 |
| openstackgerrit | Andreas Jaeger proposed a change to openstack/python-saharaclient: Implement "sahara --version" https://review.openstack.org/80631 | 16:57 |
| tosky | mattf: I think I had a similar issue (vanilla2/centos and vanilla2/ubuntu) images; I tried to check the VM but no activity | 16:59 |
| tosky | after a while the cluster went into error state | 16:59 |
| mattf | ok. i'm just going to let it run and check back later today | 17:08 |
| *** dmitryme has quit IRC | 17:11 | |
| *** Ch00k has joined #openstack-sahara | 17:11 | |
| *** Ch00k has quit IRC | 17:15 | |
| *** mattf is now known as _mattf | 17:18 | |
| openstackgerrit | Sebastien Badia proposed a change to stackforge/puppet-sahara: Fix gitreview config (rename savana to sahara) https://review.openstack.org/80638 | 17:37 |
| *** _mattf is now known as mattf | 17:41 | |
| openstackgerrit | Sebastien Badia proposed a change to stackforge/puppet-sahara: Fix gitreview config (rename savanna to sahara) https://review.openstack.org/80638 | 17:41 |
| *** themistymay has quit IRC | 17:42 | |
| *** Ch00k has joined #openstack-sahara | 17:46 | |
| crobertsrh | Is anyone currently looking into the dashboard ci-tests? The last state I see for a run is "LOST", which is new to me. Clicking on it just gives me 404. | 17:52 |
| mattf | i'm not | 17:54 |
| *** Ch00k has quit IRC | 17:59 | |
| SergeyLukjanov | crobertsrh, there is a bunch of problems with our ci lab | 18:06 |
| SergeyLukjanov | crobertsrh, starting from the data center issues... | 18:06 |
| crobertsrh | ah, ok. I'm just hoping to make sure it wasn't related to any of the renaming changes. I've been trying to double check everything by hand just to be sure. | 18:06 |
| crobertsrh | thanks for the update | 18:06 |
| elmiko | what is the standard method for generating the docs in sahara related projects, is it with tox? | 18:16 |
| SergeyLukjanov | elmiko, tox -e docs | 18:16 |
| elmiko | SergeyLukjanov: i knew it was something like that, thanks :) | 18:16 |
| SergeyLukjanov | elmiko, it's for all openstack projects that have dev docs | 18:16 |
| elmiko | cool | 18:17 |
| * crobertsrh discovers that we are already sahara and sahara-dashboard for devstack purposes :) | 18:20 | |
| SergeyLukjanov | yup | 18:20 |
| SergeyLukjanov | and for tempest | 18:20 |
| *** bob_nettleton has joined #openstack-sahara | 18:24 | |
| *** dmitryme has joined #openstack-sahara | 18:36 | |
| elmiko | i'm playing with the sahara cli from python-saharaclient, are we supposed to be able to install this to a new venv? | 18:40 |
| elmiko | (i realize tmckay is probably the one to ask, but he's out...) | 18:41 |
| crobertsrh | elmiko: I think you should be able to install it to any env you'd like. | 18:41 |
| SergeyLukjanov | elmiko, I think it should work in any venv | 18:41 |
| elmiko | ok, i did a 'python setup.py install' in a new venv, but saharaclient.api is not getting installed | 18:42 |
| elmiko | savannaclient.api is installed however | 18:42 |
| elmiko | python version 2.7.5, fyi | 18:44 |
| crobertsrh | I'll give it a try in a min | 18:50 |
| elmiko | crobertsrh: k, thanks. i'm looking through the source tree now. really a stumper... | 18:51 |
| crobertsrh | elmiko: I think I'm seeing both get installed | 18:54 |
| elmiko | crobertsrh: hrm... wonder what is messed up in mine | 18:54 |
| elmiko | can you run sahara from the cli? | 18:55 |
| crobertsrh | yes | 18:55 |
| *** dmitryme has quit IRC | 18:55 | |
| elmiko | weird | 18:55 |
| elmiko | well, time to dust off and try this again | 18:56 |
| elmiko | hmm, same result | 18:57 |
| crobertsrh | Are you sure that you grabbed the latest? | 18:58 |
| crobertsrh | last commit is 96bb7a73be111252d6d012aed1ca18e4e0385059 | 18:58 |
| elmiko | yup, got it | 18:59 |
| elmiko | i'm gonna do a fresh get from the repo, maybe i have something stale in here | 18:59 |
| elmiko | crobertsrh: ok, clean pull from the repo did it, i must have had bad stuff cached | 19:03 |
| crobertsrh | whew | 19:03 |
| elmiko | whew is right, i couldn't figure out why it wouldn't grab api... | 19:03 |
| crobertsrh | it would have been easy to blame Trevor for leaving early | 19:04 |
| elmiko | totally :) | 19:04 |
| crobertsrh | elmiko: Any chance you've managed to start up clusters on your machine (either via api or dashboard)? | 19:22 |
| elmiko | yes i have | 19:22 |
| elmiko | using httpie and sahara, via api | 19:22 |
| *** Ch00k has joined #openstack-sahara | 19:22 | |
| elmiko | and ran a simple pi job | 19:22 |
| elmiko | :) | 19:22 |
| crobertsrh | Nice. Any chance you've ever had clusters fail to come up (ie: a datanode doesn't want to come up)? | 19:23 |
| elmiko | not yet | 19:23 |
| elmiko | it took awhile for the cluster to start but that was about it | 19:23 |
| elmiko | and i had an issue with my auth token timing out | 19:23 |
| crobertsrh | Ok, maybe I'm just not being patient enough. | 19:23 |
| crobertsrh | I keep winding up with a cluster that starts 2 of my 3 datanodes (after about 5-7 min) | 19:24 |
| elmiko | hmm weird | 19:24 |
| crobertsrh | The 3rd DN fails to start...and on that node, I'm seeing that /mnt/lib doesn't exist | 19:24 |
| elmiko | i followed the quickstart instructions and it basically worked | 19:24 |
| crobertsrh | Yeah, I used to be able to make lots of clusters :) | 19:24 |
| elmiko | it took a really long time for the nodes to get initialized | 19:24 |
| crobertsrh | 10 min? Longer? | 19:25 |
| elmiko | no, not longer than 10, but maybe like 5 min | 19:25 |
| crobertsrh | Ok | 19:25 |
| elmiko | when i ssh'd into the master node i saw that there had been several failed logins too | 19:25 |
| crobertsrh | I must have done something bad | 19:25 |
| elmiko | well, maybe not, keep in mind i'm really just exploring how to get this beast moving, so i may have done some things wrong | 19:26 |
| crobertsrh | I just started having this issue when I got my new machine about 3 weeks back. | 19:27 |
| crobertsrh | Maybe I'll try with fewer datanodes....less chance for something to go wrong | 19:28 |
| *** tosky has quit IRC | 19:30 | |
| *** dmitryme has joined #openstack-sahara | 19:35 | |
| bob_nettleton | mattf, do you have time to chat regarding the DIB issues you're running into on Fedora/Red Hat? While my testing was done on Ubuntu, I'd like to make sure we make it possible to generate these images on other platforms. | 19:35 |
| *** rhodgin has joined #openstack-sahara | 19:41 | |
| mattf | bob_nettleton, sure | 19:41 |
| *** cmart__ has joined #openstack-sahara | 19:41 | |
| mattf | i've filed a handful of patch sets that address all but one issue | 19:41 |
| *** cmart__ has left #openstack-sahara | 19:42 | |
| mattf | of course, i can spin up instances w/ the hdp 2 centos image i make, but can't get the hdp plugin to create a cluster | 19:42 |
| mattf | https://review.openstack.org/#/c/80549/ | 19:42 |
| mattf | https://review.openstack.org/#/c/80572/ | 19:42 |
| mattf | are needed to build an image on rhel | 19:42 |
| mattf | all the places where you run the init script during build actually impacts the host system | 19:43 |
| mattf | running iptables stop actually stops the firewall on the build host | 19:43 |
| mattf | silly me, i ran this on my os controller node and it took down iptables, which is necessary to keep the cluster working | 19:43 |
| mattf | there's one last issue, in the root-passwd element the echo blah | passwd is blocked on rhel by selinux | 19:44 |
| bob_nettleton | mattf, ok, was not aware of the init script issue, thought that the chroot isolated that stuff, but apparently that is not the case. I noticed the root-passwd issue you filed separately. | 19:50 |
| bob_nettleton | mattf, thanks for the info. | 19:50 |
| bob_nettleton | mattf, what kind of problems do you run into while trying to get the HDP plugin to startup a cluster? We've had success with this on our end, so was curious as to the problems you're seeing. | 19:51 |
| mattf | the chroot just isolates the filesystem namespace. when the init script is run it still works against the host system's processes | 19:51 |
| mattf | i've not had a chance to dig into it. the cluster just sits in the Configuring state (for hours) | 19:52 |
| mattf | my openstack install does not have access to the world wide web | 19:52 |
| mattf | bob_nettleton, if you can tell me that you're able to generate an hdp 2 centos image w/ the elements and start a cluster from it, i'll be somewhat comfortable assuming the issue is w/ my openstack setup | 19:54 |
| mattf | bob_nettleton, at this point, it could be that for hdp2 the missing hadoop-* packages are needed by the plugin | 19:58 |
| bob_nettleton | mattf, We've definitely had success with the HDP 2 images, and I haven't changed that install code in a while, so I'm pretty comfortable that we have this working with the latest images. I think the missing packages issue is just a typo on my part. As you mentioned, it is likely that these packages are required in HDP 1.3, but not in 2.0.6. I need to track this down separately, but I don't think that should hold up your checkin. My big | 20:03 |
| *** crobertsrh is now known as _crobertsrh | 20:44 | |
| *** mattf is now known as _mattf | 20:58 | |
| *** bob_nettleton has left #openstack-sahara | 21:08 | |
| *** bob_nettleton has joined #openstack-sahara | 21:16 | |
| *** bob_nettleton has left #openstack-sahara | 21:17 | |
| *** openstackgerrit has quit IRC | 21:21 | |
| *** openstackgerrit has joined #openstack-sahara | 21:21 | |
| *** Ch00k has quit IRC | 21:23 | |
| *** openstackgerrit has quit IRC | 21:32 | |
| *** openstackgerrit has joined #openstack-sahara | 21:32 | |
| *** rhodgin has quit IRC | 21:54 | |
| *** ErikB1 has quit IRC | 21:55 | |
| *** ErikB1 has joined #openstack-sahara | 22:18 | |
| *** witlessb_ has joined #openstack-sahara | 22:20 | |
| *** witlessb has quit IRC | 22:21 | |
| *** witlessb_ is now known as witlessb | 22:21 | |
| *** dmitryme has quit IRC | 22:21 | |
| *** themistymay has joined #openstack-sahara | 22:33 | |
| *** rhodgin has joined #openstack-sahara | 22:46 | |
| *** ErikB1 has quit IRC | 22:57 | |
| *** abonilla has joined #openstack-sahara | 23:01 | |
| abonilla | Is Sahara graduating in IceHouse? | 23:01 |
| *** witlessb has quit IRC | 23:26 | |
| *** openstackgerrit has quit IRC | 23:39 | |
| *** themistymay has quit IRC | 23:42 | |
| *** bradd1 has quit IRC | 23:46 | |
| *** bogdando has quit IRC | 23:46 | |
| *** abonilla has quit IRC | 23:46 | |
| *** rhodgin has quit IRC | 23:46 | |
| *** _mattf has quit IRC | 23:46 | |
| *** elmiko has quit IRC | 23:46 | |
| *** aignatov has quit IRC | 23:46 | |
| *** _crobertsrh has quit IRC | 23:46 | |
| *** NikitaKonovalov has quit IRC | 23:46 | |
| *** SergeyLukjanov has quit IRC | 23:46 | |
| *** openstack has joined #openstack-sahara | 23:46 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!