Friday, 2014-03-21

openstackgerritA change was merged to openstack/sahara: Fixup 'savanna' references in run_tests.sh  https://review.openstack.org/8191600:01
*** witlessb has joined #openstack-sahara00:24
*** witlessb has quit IRC00:45
*** alazarev has joined #openstack-sahara00:48
*** alazarev has quit IRC01:35
*** bradd1 has quit IRC02:13
*** bradd1 has joined #openstack-sahara02:13
*** bradd1 has quit IRC02:21
*** witlessb has joined #openstack-sahara02:56
*** witlessb has quit IRC02:56
SergeyLukjanovsavanno_sahara, hey, sahanna is a good name too :)04:20
*** akuznetsov has joined #openstack-sahara04:51
*** alazarev has joined #openstack-sahara05:01
*** Ch00k has joined #openstack-sahara05:33
*** IlyaE has quit IRC06:07
*** alazarev has quit IRC06:08
openstackgerritA change was merged to openstack/sahara: Change savanna references in top level docs  https://review.openstack.org/8160606:08
openstackgerritJenkins proposed a change to openstack/sahara: Imported Translations from Transifex  https://review.openstack.org/8199506:12
openstackgerritA change was merged to openstack/sahara-image-elements: Use specific oozie for hadoop 2 plugin  https://review.openstack.org/8061006:55
*** Ch00k has quit IRC07:03
openstackgerritSergey Reshetnyak proposed a change to openstack/sahara-image-elements: Disable hadoop swift element for vanilla 2 plugin  https://review.openstack.org/7860107:05
*** Ch00k has joined #openstack-sahara07:47
openstackgerritA change was merged to openstack/sahara: Miscellaneous renaming string fixes  https://review.openstack.org/8182107:56
openstackgerritSergey Reshetnyak proposed a change to openstack/sahara-image-elements: Disable hadoop swift element for vanilla 2 plugin  https://review.openstack.org/7860108:13
*** witlessb has joined #openstack-sahara08:17
openstackgerritSergey Reshetnyak proposed a change to openstack/sahara: Add Job History Server process to vanilla 2 plugin  https://review.openstack.org/8053508:53
openstackgerritSergey Reshetnyak proposed a change to openstack/sahara: Add Job History Server process to vanilla 2 plugin  https://review.openstack.org/8053508:54
*** dmitryme has joined #openstack-sahara09:12
openstackgerritA change was merged to openstack/sahara: Completely remove etc/savanna dir  https://review.openstack.org/8185409:15
*** akuznetsov has quit IRC09:31
*** akuznetsov has joined #openstack-sahara09:36
*** akuznetsov has quit IRC09:41
*** witlessb has quit IRC09:58
*** witlessb has joined #openstack-sahara09:59
*** akuznetsov has joined #openstack-sahara10:06
*** akuznetsov has quit IRC10:11
*** akuznetsov has joined #openstack-sahara10:11
*** themistymay has joined #openstack-sahara10:33
*** tosky has joined #openstack-sahara10:46
*** _crobertsrh is now known as crobertsrh11:08
openstackgerritYaroslav Lobankov proposed a change to openstack/sahara: Integration test for a transient cluster was added  https://review.openstack.org/7622711:22
*** ErikB has joined #openstack-sahara11:31
openstackgerritIvan Berezovskiy proposed a change to openstack/sahara-image-elements: DO NOT MERGE  https://review.openstack.org/8207511:52
*** themistymay has quit IRC12:09
*** themistymay has joined #openstack-sahara12:16
*** tosky has quit IRC12:16
*** savanno_sahara has quit IRC12:18
*** ErikB has quit IRC12:23
*** sreshetnyak has quit IRC12:36
*** _mattf is now known as mattf12:37
openstackgerritA change was merged to openstack/sahara: Change remaining references in the doc subdir  https://review.openstack.org/8189812:38
*** ErikB1 has joined #openstack-sahara12:55
*** elmiko has joined #openstack-sahara13:01
*** tosky has joined #openstack-sahara13:01
*** ErikB1 has quit IRC13:03
*** tmckay has joined #openstack-sahara13:16
elmikoSergeyLukjanov: i saw your message regarding feature freeze, do i need to do anything with that feature request or just let it marinade until we reopen for features?13:18
aignatovelmiko: let it marinade for opened master for Juno13:21
*** Ch00k has quit IRC13:23
elmikoaignatov: got it :)13:23
*** Ch00k has joined #openstack-sahara13:24
tmckayaignatov, hi.  After everything is merged, I think the only place we have savanna strings still is a few places in the plugins dir13:32
crobertsrhAnyone see this before?  I'm trying to start a 3 node cluster.  2 of the 3 nodes seem to be working properly (ie:  I can ssh -l fedora to them and it logs me in).  On the 3rd node, I'm prompted for a password (and savanna can not login to this node either, which causes the cluster start to hang forever).13:32
tmckaycrobertsrh, haven13:33
tmckayhaven't seen that before13:33
tmckaysame image?13:33
tmckayI guess it would have to be13:33
crobertsrhYeah, same image13:33
aignatovtmckay: cool, great progress, so you are about on commit to finish renaming completely? :)13:34
aignatov*on commit -> one commit13:34
tmckayI think so.  I have to look more carefully at plugins, I'm less familiar there.  I don't want to break something13:35
tmckayaignatov, last few references are to file image names, and hostnames in documentation13:35
tmckaybesides plugins, I mean13:35
*** witlessb has quit IRC13:37
aignatovtmckay: image names on the savanna-files you mean?13:37
aignatovhttp://sahara-files I meant13:38
tmckayyes, sorry, bad typing :)13:38
*** witlessb has joined #openstack-sahara13:38
*** IvanBerezovskiy1 has joined #openstack-sahara13:41
tmckayaignatov, oops, I think I left "-i" some of my "ack -i savanna" searches.  :-/  Still a few scattered strings in docs, tools, tests.  Curse you, "-i " :P13:46
*** sreshetnyak has joined #openstack-sahara13:47
elmikotmckay, yea i saw a Savanna yesterday but i figured you'd find it eventually ;)13:47
tmckayelmiko, I should alias ack so -i is the default13:48
elmikolol13:48
tmckayThis is like pine needles from Christmas trees.  August, and you're still finding them.13:48
elmikoyou will so forget about that, and then wonder why you can't get case sensitive searches13:48
elmikototally13:48
tmckayelmiko, I could have "ack" and "Ack" :)13:49
openstackgerritYaroslav Lobankov proposed a change to openstack/sahara: Integration test for a transient cluster was added  https://review.openstack.org/7622713:49
aignatovtmckay: interesting thing is here https://github.com/openstack/sahara/blob/master/sahara/plugins/hdp/hadoopserver.py#L23-L2813:49
aignatovwe should ask HW guys to update theirs repos and links13:50
tmckayaignatov, yes.  I thought I saw an email or a request on IRC for that at some point, but we could raise it again13:51
elmikotmckay, i like it13:51
tmckayaignatov, mattf will have to spin python-django-sahara someday, too13:51
aignatovtmckay: shame on me, what is the python-django-sa[vann][r]a?13:53
tmckayaignatov, it's some package needed for horizon on Fedora, I think (crobertsrh ^^)13:54
aignatovah, ok, yes we definitely need to rename it13:55
tmckay"Savanna plugin for the OpenStack Dashboard"13:55
tmckaypackage description13:55
crobertsrhYes13:57
crobertsrhOk, this is getting creepy.  In any N node cluster I create right now, I wind-up with N-1 nodes that I can log into via ssh -l fedora (keypair for my local box is added).  For the Nth machine, I get prompted for a password (and of course, savanna can not login to that instance either).13:58
tmckaycrobertsrh, are you sure that it's active?13:58
crobertsrhYeah, instance shows-up as active13:58
crobertsrhand I can see the login prompt on the console13:59
crobertsrhssh "works" but only gets me a password prompt13:59
tmckaycrobertsrh, are you doing something new?  New environment, install, something?13:59
crobertsrhit's like that box didn't get the keypair13:59
tmckayI've run cli and api integration tests probably 100s of times and never seen that13:59
crobertsrhI have the latest sahara-api and dashboard13:59
tmckayhmm.  Maybe one of us should try to reproduce.  What's your devstack?  I am running master, and I put the reclone back so it should be the tip14:00
tmckaycrobertsrh, are you just whipping up templates through the UI?14:00
* tmckay brb14:01
aignatovcrobertsrh: which image are you using?14:02
aignatovbut not sure if it's image-related project14:02
crobertsrhhttp://sahara-files.mirantis.com/savanna-icehouse-vanilla-1.2.1-fedora-19.qcow214:02
crobertsrhmy devstack is from master14:03
toskycrobertsrh: sorry to jump in: in my configuration (devstack) with fairly updated code, dashboard complaints when I log in that it can't fine <myip>/dashboard address - if I replace /dashboard with /project it works, do you know if it is a known issue?14:03
aignatovI'll try this one, crobertsrh14:03
crobertsrhtosky:  I wonder if the base horizon project eliminated the /dashboard URL14:04
crobertsrhI never use the /dashboard URL, so I didn't notice the change14:05
toskycrobertsrh: but then why the first redirect after login in my case?14:05
elmikocrobertsrh: i can't imagine they eliminated /dashboard as the icehouse install from rdo still recommends hitting that as the main url14:06
aignatovbtw, I always using horizon from stable/havana14:06
tmckaycrobertsrh, is the node that's failing a unique type?  That is, is there only one of that specific type in the templates your using?  Maybe the machine is failing to configure all the way...14:07
tmckayjust a thought.  I did discover that if you use really long names for instances, the ips won't be assigned properly for some reason14:08
crobertsrhtmckay:  The node that always seem to fail seems to be a worker node (at least so far).  My template is 1 master (oozie, nn, jt) and N workers (dn, tt)14:08
tmckayI was using uuids in machine names and they failed14:08
tmckaystrange14:09
crobertsrhOk, there might be a pattern emerging for me.....one more trial coming up...14:13
crobertsrhOk, for me, it seems to be the node that gets the "workers-001" label that always fails.14:16
crobertsrhThe first node from my second defined node group in that template14:17
* crobertsrh will try rebooting....just in case something really weird is hosing him14:17
* crobertsrh reboots14:18
*** crobertsrh has left #openstack-sahara14:18
*** crobertsrh has joined #openstack-sahara14:20
*** bradd1 has joined #openstack-sahara14:27
openstackgerritTrevor McKay proposed a change to openstack/sahara: Missed renaming in docs  https://review.openstack.org/8210214:29
*** alazarev has joined #openstack-sahara14:30
crobertsrhOk, this is odd....after a reboot and a fresh stack, my cluster appears to be on the way to successful startup14:30
crobertsrhI had tried fresh stacks without rebooting, but somehow, the reboot must have solved my problem14:32
elmikogood ole windows fix14:32
*** rhodgin has joined #openstack-sahara14:33
crobertsrhYeah, did I mention that I was running Windows Me?14:33
elmikoawww, not Windows Bob?14:33
*** IvanBerezovskiy1 has quit IRC14:33
openstackgerritTrevor McKay proposed a change to openstack/sahara: Missed renames in code base  https://review.openstack.org/8211614:58
crobertsrhOk, am I going insane??  Now when I go to start a cluster, my datanodes are not all coming up.  Sometimes they do, sometimes they do not.  When they do not, I notice that there is no /mnt/lib directory on that node (/mnt/log DOES exist).  Today is not my day.15:10
*** alazarev has quit IRC15:15
crobertsrhOk, now 2 out of 4 datanodes come up.  Have any of you ever seen this?  Any tips on how I can figure out what is going on here?  Any log files generated from the hadoop install process that I should look for?15:36
*** crobertsrh is now known as crobertsrh-lunch15:36
openstackgerritTrevor McKay proposed a change to openstack/sahara: Rename strings in plugins dir  https://review.openstack.org/8212915:39
tmckayaignatov, okay, I think that's it15:42
tmckayexcept for host and path names15:43
*** bradd1 has quit IRC15:45
*** bradd1 has joined #openstack-sahara15:46
*** ylobankov has quit IRC15:52
openstackgerritA change was merged to openstack/sahara: [IDH] Initial documentation for IDH plugin  https://review.openstack.org/7877915:54
*** crobertsrh-lunch is now known as crobertsrh15:58
*** alazarev has joined #openstack-sahara15:59
*** bogdando has quit IRC16:07
*** IlyaE has joined #openstack-sahara16:19
crobertsrhI have to leave for a Dr. appt soon, but here is what I see now when my datanodes fail to come up.....16:37
crobertsrhOn boxes where the datanode comes up, "ls -l / | grep mnt" gives me /mnt owned by hadoop:hadoop.  On boxes where the datanode fails, the above command shows /mnt owned by root:root.  I'll continue down that path, but if anyone knows something about it, please feel free to say something.  Thanks16:38
tmckaymimccune, I -1 the job constant change, only because I should have called out constants for subtypes too.  My mistake.16:52
tmckayI think it's better for consistency16:53
tmckaymimccune, no hurry16:53
*** mattf is now known as _mattf16:56
elmikotmckay: subtypes meaning like MapReduce.Streaming?16:56
tmckayelmiko, yeah, the "Streaming" part.  In one or two places, we actually break off the subtype and look at it, and it's still a string literal16:58
tmckayelmiko, so for completeness, we probably want JOB_SUBTYPE_STREAMING16:58
tmckaysame reasoning, to avoid typos16:58
elmikotmckay: i was wondering that too when i was implementing16:58
tmckaymake sense?16:58
elmikototally16:58
tmckayyeah, my bad for missing it in the blueprint16:58
elmikoi'll probably get to it next week, that feature is frozen anyways16:59
elmikono worries16:59
tmckayyeah, not a burning issue :)16:59
elmikoi'm doing full battle with the fedora packaing docs currently ;)16:59
tmckayexcellent16:59
tmckayluckily I think I know a Fedora packaging reviewer who can grease the rails for us for python-django-sahara17:00
*** dmitryme has quit IRC17:01
elmikonice17:01
*** Ch00k has quit IRC17:03
*** akuznetsov has quit IRC17:03
*** IlyaE has quit IRC17:12
openstackgerritA change was merged to openstack/sahara: Missed renaming in docs  https://review.openstack.org/8210217:12
openstackgerritA change was merged to openstack/sahara: Missed renames in code base  https://review.openstack.org/8211617:16
*** _mattf is now known as mattf17:16
mattftmckay, ping re https://blueprints.launchpad.net/python-saharaclient/+spec/cli-integration-tests17:16
mattfand https://review.openstack.org/#/c/75527/17:16
*** akuznetsov has joined #openstack-sahara17:23
elmikomattf, badge stuff is all set. i got the code and am reg'd17:24
mattfelmiko, great!17:28
*** IlyaE has joined #openstack-sahara17:29
mattfelmiko, btw on the periodic status update, feel free to ... "wiki rename still waiting on sergey, no update"17:29
elmikomattf, will do17:30
*** alazarev has quit IRC17:30
tmckaymattf, here17:33
mattfhey hey17:34
mattfso, i see all the individual blueprints got squashed into one17:34
tmckaymattf, yes, SergeyLukjanov request17:35
mattftwo important things have been lost, first is the ability to track completion, second is the ability to easily parallelize now that the foundation is done17:35
mattfplease find a way to at least stack completion17:35
mattffor instance, the commit under review should point to tasks in the blueprint that it's supposed to address17:36
mattfand w/ a full set of tasks (1 per old blueprint?) we can tell when it's done17:36
* mattf loathes blueprints that just grow because they weren't well boxed17:36
tmckayalright, I'll take a look.  I think we had multiple workitems on the rename stuff, maybe that will work17:37
mattfthat might, which means all that's lost is the ability for multiple people to get credit for their parallel work17:37
mattftmckay, ping me when you've massage the commit/blueprint/or both and i'll start my review again17:38
tmckaymattf, ack17:39
*** alazarev has joined #openstack-sahara17:44
mattftmckay, aignatov, was your presentation accepted?17:54
tmckaymattf, yes17:54
mattfgreat17:54
*** Ch00k has joined #openstack-sahara17:56
tmckaybah, you can't add a dependency during editing without losing everything18:02
*** akuznetsov has quit IRC18:02
mattfbps considered harmful?18:03
tmckayyes18:03
tmckayBack in my day, we just had a bug type called "RFE" and you listed work as requests for enhancement in the bug tracker.  One interface, same rules18:04
mattfand it was immutable, which was good and bad18:04
*** witlessb has quit IRC18:16
*** witlessb has joined #openstack-sahara18:17
tmckaymattf, okay, updated https://blueprints.launchpad.net/python-saharaclient/+spec/cli-integration-tests18:25
mattftmckay, awesome. though it's now very clear that bp has A LOT of work associated with it.18:32
tmckaymattf, yes :)  The renaming hijacked me.  I was just thinking about going after another plugin18:33
tmckaymattf, also, none of the integration tests (savanna or client) have a hive test18:34
mattfeither it should be at least split up per plugin, or ideally it'll be a very minor diff to support different plugins (change the tags and input image)18:34
mattftmckay, bitcoin!18:34
tmckayhive wasn't working when they were written, that is probably a worthy addition since it applies across plugins18:34
tmckaydoh18:34
elmikolol, busted tmckay18:34
tmckayI will be homeless soon18:35
elmikowe should really be using dogecoin, bitcoin is way to expensive18:35
mattfoof, still around 600USD eh?18:36
mattfthat's unfortunate18:36
elmikototally...18:36
tmckaymattf, I'm fine with splitting the bp per plugin, as long as we don't have dueling core members arguing about granularity ;-)18:36
mattfwho knows, i thought they were expensive at 11USD apiece, and skipped buying a bunch at 1.5USD18:36
mattfSergeyLukjanov won't object this week, he's too busy18:37
* mattf grins18:37
tmckaylol18:37
tmckayokay, done then18:37
tmckaymakes sense18:37
mattfheh, i say hold off until you figure out how big the diff is between plugins18:37
mattfif it's a single file subclass then probably not worth splitting18:37
tmckayalright.  I'm going to try getting HDP up and going18:37
tmckaymattf, hmm, aignatov mentioned some sahara validation bugs that he thought we should nail for icehouse, maybe I should hit those first.  Or are you hungry for more cli?18:38
* tmckay hasn't actually looked at the bug list for a while18:39
mattftmckay, cli...18:39
tmckayokey doke18:39
SergeyLukjanovmattf, what should I object? :)18:39
mattfshhhh18:39
tmckayI'm thinking I have a better chance of running devstack on RHEL vs Fedora to host an HDP cluster, mimccune did you get anywhere with that?  Haven't tried.18:41
tmckayelmiko ^^18:43
elmikotmckay: running devstack on rhel6.5 is odd18:44
tmckaydoes it work?18:44
elmikothere is a part in stack.sh that resets the message bus and causes the current user to log out18:44
tmckayoh, great18:44
elmikoi couldn't get it to finish the stack.sh script, and i didn't dig much further at that point18:45
elmikoi suppose if you can avoid doing the bus reset it would work though18:45
tmckayhmm, well, I suppose RDO might work with current sahara...  I want something where I don't have to try hard to get HDP installed18:45
tmckaythen just point sahara at it18:46
tmckayall right, thanks18:46
elmikoyea, icehouse from RDO seems to be pretty stable. i was just about to link sahara up with that install when i got sidetracked18:46
tmckayk18:46
*** mattf is now known as _mattf18:48
*** boris-42 is now known as boris-the-blade-18:49
*** boris-the-blade- is now known as boris-the-blade18:50
*** dmitryme has joined #openstack-sahara18:59
*** tosky has quit IRC19:05
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Added python-pip installation to dev environment instruction  https://review.openstack.org/8217119:08
SergeyLukjanovupcoming design summit format overview - http://fnords.wordpress.com/2014/03/20/upcoming-changes-to-design-summit-format/19:15
*** bradd1 has quit IRC19:17
*** alazarev has quit IRC19:36
*** bradd1 has joined #openstack-sahara19:41
*** tmckay has quit IRC19:47
*** dmitryme has quit IRC19:48
*** dmitryme has joined #openstack-sahara19:49
*** witlessb has quit IRC19:59
*** dmitryme has quit IRC20:09
*** tmckay has joined #openstack-sahara20:14
*** openstackgerrit has quit IRC20:22
*** openstackgerrit has joined #openstack-sahara20:23
*** IlyaE has quit IRC20:42
*** alazarev has joined #openstack-sahara20:46
*** alazarev has quit IRC20:57
*** alazarev has joined #openstack-sahara20:59
openstackgerritA change was merged to openstack/sahara: Override 'savanna' strings in openstack/common  https://review.openstack.org/8188921:01
openstackgerritA change was merged to openstack/sahara: Rename strings in plugins dir  https://review.openstack.org/8212921:08
*** Ch00k has quit IRC21:10
*** bradd1 has quit IRC21:28
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Added missing lib to dev UI installation guide  https://review.openstack.org/8221621:30
*** tmckay has left #openstack-sahara21:42
*** themistymay has quit IRC21:42
*** ErikB has joined #openstack-sahara21:46
*** IlyaE has joined #openstack-sahara21:49
*** dmitryme has joined #openstack-sahara22:03
*** dmitryme has quit IRC22:11
*** bradd1 has joined #openstack-sahara22:18
*** elmiko has quit IRC22:24
openstackgerritJenkins proposed a change to openstack/sahara: Updated from global requirements  https://review.openstack.org/8223822:35
*** ErikB has quit IRC22:35
*** rhodgin has quit IRC23:21
*** ErikB has joined #openstack-sahara23:34
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: [IDH] Integration tests for IDH 3.0.2  https://review.openstack.org/7971923:52
*** witlessb has joined #openstack-sahara23:53
*** IlyaE has quit IRC23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!