Monday, 2016-12-05

*** masber has joined #openstack-sahara00:02
*** masber has quit IRC00:22
*** ltosky[m] has quit IRC01:52
*** ltosky[m] has joined #openstack-sahara02:21
*** Poornima has joined #openstack-sahara03:25
*** sudipto has joined #openstack-sahara04:17
*** sudipto has quit IRC04:38
*** GB21 has joined #openstack-sahara05:42
*** sudipto has joined #openstack-sahara05:47
*** sudipto has quit IRC05:48
*** ltosky[m] has quit IRC06:24
*** zemuvier has joined #openstack-sahara06:27
*** tuanluong has joined #openstack-sahara06:35
*** shuyingya has joined #openstack-sahara06:37
*** rcernin has quit IRC06:39
*** htruta` has joined #openstack-sahara06:48
*** shuyingya has quit IRC06:48
*** htruta has quit IRC06:53
*** shuyingya has joined #openstack-sahara06:54
vgridnevshaggycat,  that is a room for sahara developers, we are making some discussions right there. So, yeah, we know some Sahara's developers ...06:55
*** esikachev has joined #openstack-sahara06:56
*** masber has joined #openstack-sahara07:02
vgridnevsaying about Spark 2.0.0 I guess so, it's possible to support 2.x spark in sahara plugin for sure, but I can't say about timeframe.07:03
vgridnevshaggycat07:03
vgridnev^^07:03
masberhi07:05
masberhow long does sahara needs to deploy a vanilla hadoop cluster with 2 nodes?07:05
masberis there a document explaining the process? is there a way I can see the state of the cluster creation so I can check if everything is going forward as expected?07:06
vgridnevmasber, I can't exact time, but usually it depends on time of creation of instances. Then sahara process additional configurations07:08
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config: TESTCOMIT PY3  https://review.openstack.org/40466507:08
vgridnevyou can use event log feature to track status of cluster creation07:08
masbervgridnev, instances are created fast, just wondering what is supposed to do when satus is "waiting"07:09
vgridnevyou can cluster details page in UI and there you can see page with events (Event log) that will show what step are currently running07:11
vgridnevit can be waiting for SSH remote, for example07:11
masbervgridnev, ok sorry I just saw that, it says "Wait for instance accessibility"07:15
vgridnevmasber, quick question;07:15
vgridnevwhat image you are using?07:15
vgridnevand what username was used to register image?07:15
masberimage is sahara-newton-vanilla-2.7.1-centos7.qcow207:16
masberyes, you are right I put the wrong username when I registered the image07:16
vgridnevmasber, what username?07:16
vgridnevthat should be centos07:16
masberI put centos7-vanilla as username... my bad07:17
masberok, ok let me quickly try again07:17
vgridnevNewton code, right? there is should be warning to use correct username during  image registration .....07:18
masberIm using newton yes07:20
*** sudipto has joined #openstack-sahara07:21
*** sudipto_ has joined #openstack-sahara07:21
*** mkoderer___ is now known as mkoderer__07:23
vgridnevsudipto, just read your message. it sounds interesting. actually hadoop-streaming is not maintained by sahara developers.07:23
masbervgridnev, yes I can see a warning image no the image registration dialog07:24
vgridnevNo images in drowdown? just unregister your image first, then register it again07:25
masbervgridnev, it still says "Wait for instance accessibility"07:25
masberI changed the image username to centos07:26
vgridnevanyway, it probably need some time until it will become accessible07:28
*** rcernin has joined #openstack-sahara07:28
*** rcernin has quit IRC07:29
vgridnevanother question is: are you using floatings to access instances?07:29
masbervgridnev, I only use floating for the master node07:32
*** rcernin has joined #openstack-sahara07:32
masberthen, on the cluster template I specify private as neutron management network07:33
masber*on the launch cluster dialog07:33
vgridnevso, master node is a proxy node?07:34
vgridnevhave you specified that as a proxy?07:34
openstackgerritAlina Nesterova proposed openstack/sahara-tests: [doc] Added doc for Sahara Tempest plugin  https://review.openstack.org/38239507:36
masbermaster node ==> Floating IP Pool --> public and "proxy gateway" --> unticked07:36
vgridnevyou need select proxy gateway in such case, if you are using only one floating07:37
masbervgridnev, ok, let me change that07:37
vgridnevyou will need to recreate cluster after that07:38
masbervgridnev, you mean recreate the cluster template and the nodes template?07:41
vgridnevnope07:41
vgridnevonly cluster, I think07:41
masberkk07:41
openstackgerritAlina Nesterova proposed openstack/sahara-tests: [doc] Updated doc for Sahara scenario tests  https://review.openstack.org/38235007:47
openstackgerritAlina Nesterova proposed openstack/sahara-tests: [doc] Added doc for Sahara Tempest plugin  https://review.openstack.org/38239507:52
*** rcernin has quit IRC07:52
*** pgadiya has joined #openstack-sahara07:52
*** rcernin has joined #openstack-sahara07:59
*** tosky has joined #openstack-sahara08:00
masbervgridnev, I recreated the nodes and the cluster templates and same thing08:00
*** rcernin has quit IRC08:01
masberis says waiting for instance accessibility08:01
masberthis step has 2 stages08:01
vgridnevall nodes are not accessible?08:01
masberstage 1 is completed which is the master node08:01
masberso I am guessing it can't access the worker node08:02
vgridnevhm, interesting08:02
toskycan you access the node through ssh with the specified key, if you try manually?08:02
vgridnevtosky, I guess not, since doesn't have floating08:02
masberscreenshot http://pasteboard.co/63XUudD6V.png08:03
*** openstackgerrit has quit IRC08:03
*** rcernin has joined #openstack-sahara08:03
masbertosky, let me try that08:03
vgridnevmasber, I guess we need some logs from sahara now08:03
masbervgridnev, but I can try through the router ns?08:03
vgridnevI guess so08:04
masberI can try ssh to the worker through the router ns, one sec08:04
vgridnevmasber, anyway08:04
vgridnevwe will need sahara logs to understand why it's not accessible by proxu08:05
vgridnevproxy*08:05
masbervgridnev, yes I can ssh to the worker --> http://pastebin.com/raw/CsVBZjuF08:06
masberhttp://pasteboard.co/642jkkB2G.png08:07
masberok I will paste the logs, give me 1 sec08:07
masbervgridnev, not sure if this is what you need? http://pastebin.com/raw/uZ0uxh9208:12
*** hoonetorg has quit IRC08:12
vgridnevmasber, I think no08:13
masberthose are the only logs I can see in /var/log/sahara08:13
vgridnevsahara-api absolutely unneeded, but sahara-engine seems quite incomplete08:14
vgridnevuh08:14
vgridnevjust INFO log level, .....08:14
vgridnevthat is the problem08:14
vgridnevwe will need debug logs, I guess08:15
masberso change config file?08:15
vgridnevyep08:15
masberok debug parameter is false08:16
masberpublish_errors is commented08:16
masberdefault_log_levels also commented08:18
masberpublish_errors is false08:18
masbervgridnev, what should I change on the log files?08:19
vgridnevyou need to enable debug and recreate cluster08:20
masberok, no problem08:21
*** nkrinner has joined #openstack-sahara08:25
*** hoonetorg has joined #openstack-sahara08:28
*** afazekas has quit IRC08:29
*** afazekas has joined #openstack-sahara08:34
*** hoonetorg has quit IRC08:36
*** jamielennox is now known as jamielennox|away08:40
*** hoonetorg has joined #openstack-sahara08:49
*** egafford has joined #openstack-sahara08:52
masbervgridnev, ok, I think I got it now --> http://pastebin.com/raw/8qAB6TtL09:04
*** tuanluong has quit IRC09:07
*** tuanluong has joined #openstack-sahara09:07
toskyCan't login to node, IP: 192.168.1.101, reason SSHException: Error reading SSH protocol banner09:12
toskywell, and if you try manually?09:12
*** hoonetorg has quit IRC09:16
*** openstackgerrit has joined #openstack-sahara09:18
openstackgerritEmilien Macchi proposed openstack/puppet-sahara: CI test - never merge  https://review.openstack.org/40682809:18
*** egafford has quit IRC09:22
masbertosky, I can ssh manually09:27
masberwell I could on the previous cluster, let me try again09:28
masbertosky, I can ssh from the netns --> http://pastebin.com/ccVUGU3e09:29
*** egafford has joined #openstack-sahara09:31
toskynot from the netns09:35
toskyyou need direct access (or indirect through the main node)09:35
*** ltosky[m] has joined #openstack-sahara09:42
masbertosky, 192.168.1.101 is the worker node using private IP, how can I manually test the connectivity form the main node to 101? I cant find the keypair inside the main node09:42
masberauto security group is enabled09:44
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/40685709:47
masberI also put the neutron management network as private09:49
*** egafford has quit IRC09:52
openstackgerritVitaly Gridnev proposed openstack/sahara: testcommit grenade  https://review.openstack.org/40610709:53
openstackgerritVitaly Gridnev proposed openstack/sahara: testcommit grenade  https://review.openstack.org/40610709:54
openstackgerritVitaly Gridnev proposed openstack/sahara: testcommit grenade  https://review.openstack.org/40610709:54
vgridnevtosky, seems like something prevents inderect access09:58
vgridnevon centos7 with vanilla plugin09:58
*** egafford has joined #openstack-sahara10:00
*** zemuvier has quit IRC10:03
*** zemuvier has joined #openstack-sahara10:03
openstackgerritAlina Nesterova proposed openstack/sahara-ci-config: Added killing of all python processes  https://review.openstack.org/39899310:05
toskyvgridnev: I think it's a configuration issue10:14
esikachevdgonzalez: hi! are you here?10:14
toskyvgridnev: doesn't the "proxy " configuration require some settings? I usually try with all instances on the floating IP network10:14
toskyI mean, with a floating IP assigned10:14
toskymasber: does all the node have a floating IP assigned (with the floating IP network)?10:15
masbertosky, I only have 2 nodes (1 worker and 1 master)10:15
masberthe worker does not have Floating IP10:15
masberthe master has10:15
toskytry with the floating IP for the worker too10:15
toskyotherwise you should mark the master as proxy (and then I don't remember if you need other configuration)10:16
masbertosky, I don't have free floating IPs for the workers unfortunately10:16
vgridnevactually I already said to do so, tosky10:16
masbermaster is already setup as proxy10:16
toskyvgridnev: ups, sorry10:17
masbertosky, look this http://pasteboard.co/BPi7J7O6.png10:18
toskymaybe the proxy_command parameter needs some tuning10:19
masbertosky, what about this https://ask.openstack.org/en/question/87430/sahara-cant-login-to-nodes/?10:20
masberhow can I know if the run_subprocess is not spawing any command?10:21
toskyuh, rootwrap10:21
vgridnevtellesnobrega, ping me when you around10:24
vgridnevwe will discuss your change10:24
masbertosky, ok, but is there a log that tells me about this permission issues?10:26
toskynot more than sahara-engine.log10:27
masberok, I will try this and see if helps...10:30
masbertosky, another question, do you know if there is a plan to integrate apache phoenix to the ambari plugin?10:31
toskymasber: I don't think that there is, and I guess it depends on people contributing it :)10:31
toskymasber: vgridnev can most likely answer this better than me10:31
*** tuanluong has quit IRC10:32
vgridnevmasber, I'm not sure there is a exact plan to support phoenix. If you really need that, we can help you to support that. that should not be so hard, I guess10:33
*** tuanluong has joined #openstack-sahara10:33
masbervgridnev, what would be the plan? can we do it through the community or do we need to contact hortonworks for support?10:34
vgridnevI guess that hortonworks will not contribute that to sahara.10:36
vgridnevActually, so you need to ask sahara's community (us) to help you with support of that10:36
vgridnevyou may file blueprint for sahara project: https://blueprints.launchpad.net/sahara10:36
openstackgerritMerged openstack/sahara-ci-config: Added killing of all python processes  https://review.openstack.org/39899310:36
vgridnevthat is first and the obvious step of the process10:37
dgonzalezesikachev: hi, I am here now :)10:37
esikachevdgonzalez: i have question about https://etherpad.openstack.org/p/sahara-ocata-summit10:38
vgridnevsince change itself should not be so hard, we can implement support without specification, but we require that for some kind of features10:38
esikachevdgonzalez: about point "MMMMM Manila testing and integration - dgonzalez"10:38
vgridnevmasber, the hard part is that to find a person, who will be working on that. currently our team is quite small, actually.10:39
dgonzalezesikachev: ok, I haven't started with this yet, but i plan to look into it before christmas10:40
vgridnevegafford, tosky we need additional reviews on https://review.openstack.org/#/q/status:open+topic:bug/164479910:41
vgridnevmasber, tosky building centos7 image for vanilla plugin to try that with indirect access10:44
vgridnevmasber, about phoenix, is there some documentation on how to deploy that with HDP?10:45
masbervgridnev, as far as I know phoenix is supported by HDP out of the box10:46
masbervgridnev, does this helps https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.6/bk_installing_manually_book/content/installing_phoenix_rpm.html?10:48
vgridnev"out of the box " is quite abstract. any kind of documentation on how to add that as a service?10:49
toskyvgridnev: thanks, I can't check right now (centos7)10:50
esikachevdgonzalez: ok, thanks10:51
egaffordvgridnev: Reviewed; feel free to WF+1 (or tell me to; happy to push the button. :) )10:51
masbervgridnev, I actually can see one of the HBase parameter called "phoenix_sql_enabled"10:51
*** nkrinner has quit IRC10:52
vgridnevegafford, you may press the button for sure10:52
egaffordvgridnev: Pushing buttons.10:52
vgridnevmasber, by docs seems like it shouldn't be hard to support phoenix in hdp plugin10:56
*** shuyingya has quit IRC10:58
*** shuyingya has joined #openstack-sahara10:59
*** tesseract has joined #openstack-sahara11:05
*** tesseract is now known as Guest1725911:05
openstackgerritLuigi Toscano proposed openstack/sahara-image-elements: Remove the older version from the builder  https://review.openstack.org/40689011:08
*** GB21 has quit IRC11:15
*** GB21 has joined #openstack-sahara11:17
vgridnevtosky, so, I'm facing the same issue with centos7 image11:20
*** nkrinner has joined #openstack-sahara11:20
vgridnevany tips/ideas to take a look?11:21
toskywhat could it be? Missing rootwrap config (as that ask.openstack discussion linked above hinted)? Or maybe do we need a custom command?11:21
*** Guest17259 has quit IRC11:21
vgridnevtosky, I'm using the default configuration of sahara11:22
vgridnevcentos7 image for ambari works fine with indirect access11:22
vgridnevactually11:22
toskyoh11:23
*** masber has quit IRC11:23
*** tesseract- has joined #openstack-sahara11:24
*** tuanluong has quit IRC11:24
vgridnevtosky, ok, will try to investigate what is wrong11:36
*** nkrinner has quit IRC11:36
vgridnevI guess that something wrong with vanilla image11:36
*** nkrinner has joined #openstack-sahara11:37
*** tenobreg has joined #openstack-sahara11:39
*** tellesnobrega has quit IRC11:43
*** tellesnobrega has joined #openstack-sahara11:44
*** nkrinner has quit IRC11:44
*** tenobreg has quit IRC11:44
tellesnobregavgridnev, hey11:46
*** nkrinner has joined #openstack-sahara11:58
*** sudipto has quit IRC12:04
*** sudipto_ has quit IRC12:04
*** GB21 has quit IRC12:07
openstackgerritAlina Nesterova proposed openstack/sahara-tests: [doc] Added doc for Sahara Tempest plugin  https://review.openstack.org/38239512:32
*** shuyingya has quit IRC12:36
*** pgadiya has quit IRC12:41
vgridnevtellesnobrega, hey yourself12:51
tellesnobregasorry it took so long to respond your ping, It was kinda early for me lol12:51
vgridnevno problem12:52
vgridnevtosky, each job is tested twice for sure? https://review.openstack.org/#/c/406890/12:52
toskyvgridnev: I noticed too12:53
toskyraissa: ^^ the last patch likely needs some tuning12:53
openstackgerritMerged openstack/sahara: Updated from global requirements  https://review.openstack.org/40685712:53
tellesnobregaabout the regex on that change, maybe I'm missing something, but how the regex_search will work there. Currently the check is project_id == 'project_id' or is_public == 'True or False' (depending on the resource being true or false). So, if a resource if public, every public resource will be brought up in the query12:55
tellesnobregawhat I need to do is remove this OR is_public == and use only the project_id clause12:56
raissatosky: oh, let me take a look12:56
vgridnevtellesnobrega, you are adding tenant_id right there: https://github.com/openstack/sahara/blob/master/sahara/db/sqlalchemy/api.py#L29713:02
vgridnevand then you just calling cluster_get_all(regex_search=True, tenant_id=tenant_id)13:04
vgridnevor something like that13:05
tellesnobregaok, I will give it a try13:06
*** tesseract- has quit IRC13:27
*** egafford has quit IRC13:31
*** egafford has joined #openstack-sahara13:31
*** tosky_ has joined #openstack-sahara13:34
*** tosky has quit IRC13:35
openstackgerritAlina Nesterova proposed openstack/sahara-tests: Added -ispublic and -isprotected flags for cluster in sahara-scenario  https://review.openstack.org/29888213:39
*** dave-mccowan has joined #openstack-sahara13:40
*** Poornima has quit IRC13:42
*** zemuvier has quit IRC13:43
vgridnevtellesnobrega, moreover, we can filter by exact name like name='^name$'13:43
vgridnevso after that we can check that we have the empty query13:44
vgridnevtellesnobrega, related to https://bugs.launchpad.net/sahara/+bug/121222513:45
openstackLaunchpad bug 1212225 in Sahara "Inefficient validation checks" [Low,Triaged] - Assigned to Annapoornima Koppad (annakoppad)13:45
*** shuyingya has joined #openstack-sahara13:47
*** esikachev has quit IRC13:47
*** esikachev has joined #openstack-sahara13:49
tellesnobregavgridnev, cool. I will check it out13:50
*** esikachev has quit IRC13:53
*** sudipto_ has joined #openstack-sahara14:25
*** sudipto has joined #openstack-sahara14:25
*** esikachev has joined #openstack-sahara14:34
*** esikachev has quit IRC14:38
*** esikachev has joined #openstack-sahara14:49
*** shuyingya has quit IRC15:05
*** GB21 has joined #openstack-sahara15:14
*** Poornima has joined #openstack-sahara15:48
*** GB21 has quit IRC16:01
*** rcernin has quit IRC16:05
*** GB21 has joined #openstack-sahara16:10
*** egafford has quit IRC16:12
*** exploreshaifali has joined #openstack-sahara16:14
*** tosky_ has quit IRC16:17
*** zioproto has joined #openstack-sahara16:18
zioprotovgridnev: hello ! :)16:18
zioprotovgridnev: I worked a bit on that sahara bug16:18
*** nkrinner is now known as nkrinner_afk16:18
zioprotoit looks like I cannot reproduce the bug when I use the hadoop-openstack.jar from hortonworks. But their code is different16:18
*** exploreshaifali has quit IRC16:43
*** zioproto has quit IRC16:45
*** esikachev has quit IRC17:05
*** esikachev has joined #openstack-sahara17:15
*** Poornima has quit IRC17:22
*** mariannelm has joined #openstack-sahara17:31
*** GB21 has quit IRC17:42
*** sudipto_ has quit IRC17:54
*** sudipto has quit IRC17:54
*** sudipto_ has joined #openstack-sahara18:00
*** sudipto has joined #openstack-sahara18:00
*** sudipto has quit IRC18:03
*** sudipto_ has quit IRC18:03
*** esikachev has quit IRC18:13
*** esikachev has joined #openstack-sahara18:18
*** _elmiko is now known as elmiko18:32
*** openstackstatus has joined #openstack-sahara18:55
*** ChanServ sets mode: +v openstackstatus18:55
*** akuznetsov has joined #openstack-sahara19:16
*** mariannelm has quit IRC19:19
*** mariannelm has joined #openstack-sahara19:19
*** exploreshaifali has joined #openstack-sahara19:21
*** mariannelm has quit IRC19:25
*** SergeyLukjanov2 has joined #openstack-sahara19:26
*** bapalm_ has joined #openstack-sahara19:26
*** vgridnev- has joined #openstack-sahara19:27
*** bapalm has quit IRC19:28
*** vgridnev has quit IRC19:28
*** SergeyLukjanov has quit IRC19:28
*** SergeyLukjanov2 is now known as SergeyLukjanov19:28
*** akuznetsov has quit IRC19:35
*** akuznetsov has joined #openstack-sahara19:47
*** akuznetsov has quit IRC19:51
*** mariannelm has joined #openstack-sahara19:51
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara: Adding tenant_id to regex_search  https://review.openstack.org/40417519:52
tellesnobregavgridnev-, can you check out ^19:53
*** exploreshaifali has quit IRC20:25
*** esikachev has quit IRC20:25
*** esikachev has joined #openstack-sahara20:26
*** esikachev has quit IRC20:30
*** esikachev has joined #openstack-sahara20:31
*** esikachev has quit IRC20:39
*** esikachev has joined #openstack-sahara21:09
*** jamielennox|away is now known as jamielennox21:13
*** ltosky[m] has quit IRC21:22
*** esikachev has quit IRC21:58
*** ltosky[m] has joined #openstack-sahara22:02
*** masber has joined #openstack-sahara22:37
*** rcernin has joined #openstack-sahara22:40
*** elmiko is now known as _elmiko23:18
*** masber has quit IRC23:33
*** esikachev has joined #openstack-sahara23:54
*** esikachev has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!