| *** tosky has quit IRC | 00:06 | |
| *** rcernin has quit IRC | 03:35 | |
| *** rcernin has joined #openstack-sahara | 03:50 | |
| *** rcernin has quit IRC | 03:57 | |
| *** rcernin has joined #openstack-sahara | 03:58 | |
| *** Bhujay has joined #openstack-sahara | 04:05 | |
| *** Bhujay has quit IRC | 04:06 | |
| *** Bhujay has joined #openstack-sahara | 04:07 | |
| *** Bhujay has quit IRC | 04:08 | |
| *** Bhujay has joined #openstack-sahara | 04:08 | |
| *** Bhujay has quit IRC | 04:09 | |
| *** Bhujay has joined #openstack-sahara | 04:10 | |
| *** Bhujay has quit IRC | 04:11 | |
| *** Bhujay has joined #openstack-sahara | 04:11 | |
| *** Bhujay has quit IRC | 04:12 | |
| *** Bhujay has joined #openstack-sahara | 04:13 | |
| *** Bhujay has quit IRC | 04:14 | |
| *** Bhujay has joined #openstack-sahara | 04:14 | |
| *** Bhujay has quit IRC | 04:58 | |
| *** Bhujay has joined #openstack-sahara | 05:09 | |
| *** Bhujay has quit IRC | 05:37 | |
| *** openstackgerrit has joined #openstack-sahara | 07:17 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara-dashboard master: Imported Translations from Zanata https://review.openstack.org/632249 | 07:17 |
|---|---|---|
| *** pcaruana has joined #openstack-sahara | 07:41 | |
| *** tosky has joined #openstack-sahara | 08:43 | |
| *** rcernin has quit IRC | 08:56 | |
| openstackgerrit | Merged openstack/sahara-dashboard master: Imported Translations from Zanata https://review.openstack.org/632249 | 09:53 |
| *** raissa has joined #openstack-sahara | 10:55 | |
| *** raissa has quit IRC | 10:57 | |
| *** openstackgerrit has quit IRC | 15:51 | |
| *** pcaruana has quit IRC | 17:02 | |
| *** pcaruana has joined #openstack-sahara | 18:01 | |
| *** pcaruana has quit IRC | 18:23 | |
| tellesnobrega | tosky, are you still around? | 19:11 |
| tosky | tellesnobrega: yes | 19:12 |
| tellesnobrega | I'm trying spark images created with SIP | 19:12 |
| tellesnobrega | I'm getting an interesting error | 19:12 |
| tellesnobrega | Exception in thread "main" Invalid Response: Method POST on http://192.168.0.121/identity/v3/auth/tokens/ failed, status code: 503, status line: HTTP/1.1 503 Service Unavailable POST http://192.168.0.121/identity/v3/auth/tokens/ => 503 : <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> | 19:13 |
| tellesnobrega | <html><head> | 19:13 |
| tellesnobrega | <title>503 Service Unavailable</title> | 19:13 |
| tellesnobrega | </head><body> | 19:13 |
| tellesnobrega | <h1>Service Unavailable</h1> | 19:13 |
| tellesnobrega | <p>The server is temporarily unable to service your | 19:13 |
| tellesnobrega | request due to maintenance downtime or capacity | 19:13 |
| tellesnobrega | problems. Please try again later.</p> | 19:13 |
| tellesnobrega | </body></html> | 19:13 |
| tosky | and do other plugins work? | 19:13 |
| tellesnobrega | spark with 1.6.0 (downloaded from archive) works | 19:14 |
| tosky | uhm, so the next question is: what was sahara doing when that error happens? | 19:15 |
| tosky | I guess it's in the engine | 19:15 |
| tellesnobrega | the configuration http://192.168.0.121/identity/v3/auth/tokens/ is the same for both | 19:15 |
| tellesnobrega | this is when I'm trying to run a job | 19:15 |
| tellesnobrega | cluster starts | 19:15 |
| tosky | a job which uses swift? | 19:19 |
| tosky | maybe something related to the authentication against swift? | 19:19 |
| tellesnobrega | spark-wordcount.jar | 19:19 |
| tellesnobrega | the one from scenarios | 19:19 |
| tosky | no v3 support? :) | 19:20 |
| tellesnobrega | but it works using the other spark image | 19:20 |
| tellesnobrega | it shouldn't be a problem | 19:21 |
| tosky | oh, so maybe something is missing on the new spark image | 19:21 |
| tosky | maybe some of the jars from sahara-extra | 19:21 |
| tellesnobrega | yes | 19:21 |
| tellesnobrega | not sure what | 19:21 |
| tellesnobrega | how can I compare both images? to see what is different? | 19:23 |
| tellesnobrega | so, looking at /usr/lib/hadoop-mapreduce | 19:31 |
| tellesnobrega | the only big difference I see is that on the old image hadoop-openstack.jar is only a lib | 19:31 |
| tellesnobrega | while in the new it is a ln to hadoop-openstack-2.6.0-cdh5.11.2.jar | 19:32 |
| *** pcaruana has joined #openstack-sahara | 19:50 | |
| *** pcaruana has quit IRC | 20:11 | |
| *** pcaruana has joined #openstack-sahara | 20:24 | |
| *** tmckay has joined #openstack-sahara | 20:26 | |
| tosky | tellesnobrega: coming from CDH? | 20:36 |
| tosky | maybe we need to override it with our (if the old image has our version) | 20:36 |
| tellesnobrega | tosky, yes, from cdh, I will check it out | 20:43 |
| tosky | tellesnobrega: in sie, the swift_hadoop element installs hadoop-openstack.jar for the spark plugin; the code is used also for the CDH plugin, but the branches followed are different | 20:46 |
| tellesnobrega | I created a image using SIE and the hadoop-openstack.jar is also a link to the cdh one | 20:47 |
| tellesnobrega | I'm running a job now | 20:47 |
| tellesnobrega | see how it behaves | 20:47 |
| tellesnobrega | so, worked on the SIE image | 20:49 |
| *** dave-mccowan has joined #openstack-sahara | 20:52 | |
| tellesnobrega | with same version of the one created with SIP | 20:52 |
| tosky | same same, like same hash of the file? | 20:54 |
| tosky | also, did you check if there are more of those jars on the image, and the wrong one is used? | 20:55 |
| tellesnobrega | they are the only ones | 20:58 |
| tellesnobrega | let me check hash | 20:58 |
| tellesnobrega | is cksum the proper way to check that? | 21:02 |
| tosky | any *sum: even md5sum, even if md5 collisions are possible, shouldn't be a problem for this use case | 21:02 |
| tosky | or sha256sum | 21:02 |
| tosky | or others :) | 21:02 |
| tellesnobrega | so, they are apparently different | 21:05 |
| tellesnobrega | I ran jar tf hadoop-openstack.jar | 21:05 |
| tellesnobrega | and they are being printed in completely different order | 21:05 |
| *** pcaruana has quit IRC | 21:19 | |
| *** rcernin has joined #openstack-sahara | 22:10 | |
| *** rcernin has quit IRC | 22:17 | |
| *** tmckay has quit IRC | 22:18 | |
| *** rcernin has joined #openstack-sahara | 22:19 | |
| tellesnobrega | tosky, I think I found the issue, lets see | 22:25 |
| *** tmckay has joined #openstack-sahara | 23:09 | |
| *** tmckay has quit IRC | 23:34 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!