Wednesday, 2015-09-23

« Tuesday, 2015-09-22 Index Thursday, 2015-09-24 »
openstackgerritMerged openstack/sahara: Add wait condition for heat templates  https://review.openstack.org/16933800:05
*** ashishb has quit IRC00:05
openstackgerritMerged openstack/sahara: Add more information about configuring NTP service  https://review.openstack.org/22093800:05
openstackgerritMerged openstack/sahara: Updating vanilla imagebuilder docs  https://review.openstack.org/22096000:05
openstackgerritMerged openstack/sahara: Updated from global requirements  https://review.openstack.org/22193700:05
openstackgerritMerged openstack/sahara: [doc-day] Updated development guidelines  https://review.openstack.org/21895300:06
openstackgerritMerged openstack/sahara: Updating overview document  https://review.openstack.org/21897900:06
*** Poornima has joined #openstack-sahara00:19
*** larainema has quit IRC00:20
*** larainema has joined #openstack-sahara00:20
*** larainema has quit IRC00:21
*** larainema has joined #openstack-sahara00:22
*** larainema has quit IRC00:25
*** lvdongbing has joined #openstack-sahara00:37
*** larainema has joined #openstack-sahara00:57
*** EinstCrazy has joined #openstack-sahara00:57
*** ldb_ has joined #openstack-sahara01:08
*** lvdongbing has quit IRC01:08
*** stevemar has joined #openstack-sahara01:17
*** hdd has quit IRC01:18
*** hdd has joined #openstack-sahara01:26
*** ashishb has joined #openstack-sahara01:44
*** larainema has quit IRC01:54
*** ashishb has quit IRC02:09
*** larainema has joined #openstack-sahara02:22
*** japplewhite has joined #openstack-sahara02:40
*** japplewhite has left #openstack-sahara02:40
*** david-lyle has joined #openstack-sahara03:13
*** EinstCrazy has quit IRC03:19
*** Poornima has quit IRC03:42
*** hdd has quit IRC04:59
openstackgerritVitaly Gridnev proposed openstack/sahara: Configurable timeouts for disk preparing  https://review.openstack.org/22623805:01
*** mathspanda has joined #openstack-sahara05:02
openstackgerritVitaly Gridnev proposed openstack/sahara: Use xfs for formatting  https://review.openstack.org/22635805:02
*** egafford has quit IRC05:30
*** madong_ has joined #openstack-sahara06:06
*** larainema has quit IRC06:08
*** nkrinner has joined #openstack-sahara06:21
*** stevemar has quit IRC06:23
*** EinstCrazy has joined #openstack-sahara06:32
*** egafford has joined #openstack-sahara06:34
*** egafford has quit IRC06:39
*** ealcaniz has joined #openstack-sahara06:44
*** vgridnev has quit IRC07:07
*** witlessb has joined #openstack-sahara07:22
*** stevemar has joined #openstack-sahara07:23
*** stevemar has quit IRC07:27
*** Yanyan has joined #openstack-sahara07:32
*** macjack has joined #openstack-sahara07:32
*** madong_ has quit IRC07:44
*** madong_ has joined #openstack-sahara07:44
*** ealcaniz has left #openstack-sahara07:51
*** vgridnev has joined #openstack-sahara08:22
pino|workSergeyLukjanov: thanks again for the merges08:29
pino|workSergeyLukjanov: question: should we add jenkins a non-voting job for the ambari images?08:33
*** stevemar has joined #openstack-sahara09:25
*** stevemar has quit IRC09:28
*** tosky has joined #openstack-sahara09:36
*** ldb_ has quit IRC09:42
*** Yanyan has quit IRC09:56
openstackgerritVitaly Gridnev proposed openstack/sahara: Use correct API version for swift on instances  https://review.openstack.org/22667610:01
vgridnevelmiko, are you around?10:03
vgridnevI should be sure that I did not break something https://review.openstack.org/#/c/226676/10:04
pino|workvgridnev: he will be in ~3h or so10:06
vgridnevpino|work, ok, thanks10:06
vgridnevpino|work, probably he will see that message when will be available10:07
pino|workyep10:07
*** degorenko has quit IRC10:13
*** degorenko has joined #openstack-sahara10:19
*** esikachev has joined #openstack-sahara10:26
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add ability running tests on exist cluster  https://review.openstack.org/22585410:28
openstackgerritEvgeny Sikachev proposed openstack/sahara: [WIP] Run several edp jobs flows  https://review.openstack.org/22668810:33
openstackgerritEvgeny Sikachev proposed openstack/sahara: [WIP] Run several edp jobs flows  https://review.openstack.org/22668810:36
openstackgerritEvgeny Sikachev proposed openstack/sahara: [WIP] Run several edp jobs flows  https://review.openstack.org/22668810:39
*** EinstCrazy has quit IRC10:51
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add API methods for call verifications, DB table  https://review.openstack.org/19671310:51
*** esikachev has quit IRC11:03
*** esikachev has joined #openstack-sahara11:05
*** mathspanda has quit IRC11:18
*** shakamunyi has quit IRC11:25
*** tosky has quit IRC11:34
*** tosky has joined #openstack-sahara11:34
*** Yanyanhu has joined #openstack-sahara11:44
openstackgerritVitaly Gridnev proposed openstack/sahara: Configurable timeouts for disk preparing  https://review.openstack.org/22623811:44
*** Yanyan has joined #openstack-sahara11:46
*** Yanyanhu has quit IRC11:49
*** EinstCrazy has joined #openstack-sahara11:49
*** EinstCrazy has quit IRC11:59
*** Venkatesh has joined #openstack-sahara12:00
*** macjack has left #openstack-sahara12:01
*** Yanyan has quit IRC12:03
*** EinstCrazy has joined #openstack-sahara12:04
*** ashishb has joined #openstack-sahara12:04
*** EinstCrazy has quit IRC12:06
openstackgerritZhao Lei proposed openstack/sahara-image-elements: Remove quotes from subshell call in bash script  https://review.openstack.org/22672312:10
openstackgerritZhao Lei proposed openstack/sahara-image-elements: Show command output directly in package_utils.sh  https://review.openstack.org/22672412:11
*** Venkatesh_ has joined #openstack-sahara12:16
*** ashishb has quit IRC12:18
*** ashishb has joined #openstack-sahara12:18
*** Venkatesh has quit IRC12:19
*** Venkatesh_ has quit IRC12:22
*** raildo-afk is now known as raildo12:22
openstackgerritVitaly Gridnev proposed openstack/sahara: Use xfs for formatting  https://review.openstack.org/22635812:39
*** _crobertsrh is now known as crobertsrh12:42
openstackgerritSergey Reshetnyak proposed openstack/python-saharaclient: [DO NOT MERGE] Test commint  https://review.openstack.org/22325512:43
openstackgerritVitaly Gridnev proposed openstack/sahara: Use xfs for formatting  https://review.openstack.org/22635812:43
openstackgerritSergey Reshetnyak proposed openstack/python-saharaclient: [DO NOT MERGE] Test commit  https://review.openstack.org/22325512:46
*** tosky has quit IRC12:47
*** apavlov has joined #openstack-sahara12:52
openstackgerritSergey Reshetnyak proposed openstack/python-saharaclient: [WIP][DO NOT MERGE] Test commit  https://review.openstack.org/22325512:54
openstackgerritMerged openstack/sahara: Resolve issue with operating heat stack outputs  https://review.openstack.org/22310912:57
*** ashishb has quit IRC13:01
elmikovgridnev: hey13:01
vgridnevhey13:01
elmikolooking at that review now13:03
vgridnevI am not so sure about this bug, but it looks like if hadoop-openstack doesn't keystone v3, and it's ok to pass v2.0 in configs13:03
*** tmckay has joined #openstack-sahara13:04
elmikoit's a difficult issue13:05
elmikoafaik, only our version of hadoop-openstack has support for v3 keystone13:05
elmikoand the only time we use it is when proxy users are being used13:05
elmikoi don't think we need to change the code though, if you are not using proxy users then this will never come up13:07
elmikoi'll make a comment on the bug13:07
vgridnevshould we enforce our hadoop openstack to all plugins?13:08
elmikothe only way it could pass /v3 to the core-site.xml is if sahara is configured to use the proxy domain feature, and if you have enabled that then it won't work with the v2 endpoint which means that all swift contact from hadoop will be broken13:08
elmikoi think we should13:09
elmikobut, i think we need to discuss this with the group13:09
vgridnevgood point to add it to agenda13:10
rickflareI am getting a strange error when I launch my Cluster13:10
rickflareData too long for column Image_username??13:11
elmikorickflare: you might have an older database scheme, maybe try running `sahara-db-manage upgrade head`13:13
*** esikachev has quit IRC13:14
*** esikachev has joined #openstack-sahara13:15
elmikovgridnev: honestly, i think we should mark https://bugs.launchpad.net/sahara/+bug/1493538 as invalid13:15
openstackLaunchpad bug 1493538 in Sahara "Sahara Swift integration wrong auth URL" [Undecided,In progress] - Assigned to Vitaly Gridnev (vgridnev)13:15
*** tosky has joined #openstack-sahara13:16
vgridnevelmiko, just not use proxy users?13:16
elmikovgridnev: if you don't have the hadoop-openstack from sahara-extras, then don't use proxy users13:17
vgridnevalso, I am not sure that we use our hadoop-openstack everywhere13:17
elmikoi mean, proxy users won't work with the v2 only jar13:17
elmikoyea, we need to address that issue. i added my thoughts to the bug report13:17
vgridnevhttps://github.com/openstack/sahara-image-elements/tree/master/elements/swift_hadoop this element installs correct version of our hadoop openstack?13:22
vgridnevelmiko, ^^13:22
elmikovgridnev: well, it installs whatever is at http://sahara-files.mirantis.com/hadoop-swift/hadoop-swift-latest.jar ;)13:23
vgridnevand it's used only for spark? tadamn13:23
elmikolooks like its included in vanilla as well13:24
elmikobut i think that may be the wrong jar file, i created a vanilla image last week and it did not have v3 support13:24
elmikooh, only for v1 vanilla... =(13:25
vgridnevsad13:25
elmikoyea, i guess we just need to add it back into the vanilla images. i'll try it out today13:26
vgridnevelmiko, ok, thanks!13:26
*** stevemar has joined #openstack-sahara13:26
elmikothanks for bringing it up vgridnev, assuming it works i'll make a bug for sahara-image-elements13:26
pino|work... with a patch i guess13:27
pino|work? ;)13:27
vgridnevok, therefore let's mark for sahara as invalid, right?13:27
openstackgerritVitaly Gridnev proposed openstack/sahara: Use xfs for formatting  https://review.openstack.org/22635813:28
*** stevemar has quit IRC13:29
*** tosky has quit IRC13:29
*** tosky has joined #openstack-sahara13:36
*** lvdongbing has joined #openstack-sahara13:40
elmikovgridnev: yea, mark as invalid13:41
elmikoi changed it13:42
openstackgerritEvgeny Sikachev proposed openstack/sahara: [WIP] Run several edp jobs flows  https://review.openstack.org/22668813:52
*** egafford has joined #openstack-sahara13:54
*** stevemar has joined #openstack-sahara13:55
rickflareits still complaining my image name is too long14:03
rickflareI used the exact name the image create script named the image14:03
elmikohmm, odd14:04
elmikohow long is the name?14:04
*** lvdongbing has quit IRC14:08
rickflarecentos7_sahara_vanilla_hadoop_2_7_1_latest.qcow214:16
elmikohmm14:19
*** ashishb has joined #openstack-sahara14:19
elmikowell, let's look at the db model for images and see what the length is14:20
rickflareok14:21
openstackgerritvenkatesh proposed openstack/sahara-image-elements: Remove quotes from subshell call in bash script  https://review.openstack.org/22672314:22
elmikothis is when you are registering an image?14:22
rickflareno14:22
rickflarethe image registers fine14:23
rickflareI get the error when I launch the cluster14:23
elmikoahh, ok14:23
elmikocan you copy the error output into a pastebin?14:24
*** lvdongbing has joined #openstack-sahara14:24
toskythere is a limit for the filename14:24
rickflareits hard because it shows up in horizon14:30
rickflareand I cant copy and paste it14:30
elmikorickflare: yea, the easy fix here is just to reduce the size of the filename14:30
rickflareok ill try that14:30
elmikoare reduce the size of the name you add to horizon when uploading the image14:30
rickflarebut the register should catch this14:30
elmikos/are/or14:30
rickflarebecause this will happen again14:30
elmikogood thought, open a bug =)14:31
rickflareI know it esp the image create script makes these file names14:31
rickflarepeople are going to use them14:31
rickflarewill do14:31
rickflarethanks guys14:31
rickflareill let you know if it fixes my issue14:31
elmikoright, but when you register the image with glance you don't have to use the filename for the image name14:31
elmiko(not that it matters, this should still be caught before cluster creation)14:31
rickflareyes it should just say this file name is too long etc14:32
elmikoright14:32
rickflarei hope special chars are not causing an issue14:32
vgridnevelmiko, what do you think about this bug? Should we mark that as fix committed: https://bugs.launchpad.net/sahara/+bug/1490687 ?14:33
openstackLaunchpad bug 1490687 in Sahara "Documentation should be updated for the Liberty release" [High,In progress] - Assigned to Michael McCune (mimccune)14:33
elmikovgridnev: good catch, i'll look through the list and make sure everything is merged. then we can close it14:33
elmikoactually, we could just close it as the doc week is over.14:34
elmikoalso, i think the swift_hadoop element is not quite correct14:35
openstackgerritSergey Reshetnyak proposed openstack/python-saharaclient: [WIP] Fix functional tests  https://review.openstack.org/22682814:35
vgridnevwhy?14:36
vgridnevabout swift_hadoop I meant14:37
elmikoit's copying the jar file and naming it hadoop-swift.jar14:37
elmikobut the actual jar is named hadoop-openstack-<version>.jar14:37
elmikoso like hadoop-openstack-2.7.1.jar14:37
elmikoi'll makes some bugs and patches though, we'll get this straight14:38
elmikoi added that "patches" part just for you pino|work ;)14:38
pino|work\o/14:38
elmikohaha14:38
vgridnevso, if we just put hadoop swift without renames, we will not include that in classpath?14:40
*** stevemar has quit IRC14:40
elmikoi don't think so, but i will test it14:40
elmikoalso, the wget command fails because that file doesn't exist on the target image14:41
elmikofrom the elements, wget -O $HDFS_LIB_DIR/hadoop-swift.jar $SWIFT_LIB_URI14:42
elmikofails with: /usr/share/hadoop/lib/hadoop-swift.jar: No such file or directory14:42
*** stevemar has joined #openstack-sahara14:46
openstackgerritMerged openstack/sahara: Generate random heat stack name for cluster  https://review.openstack.org/22397914:47
openstackgerritEvgeny Sikachev proposed openstack/sahara: [WIP] Run several edp jobs flows  https://review.openstack.org/22668815:07
*** lvdongbing has quit IRC15:08
openstackgerritEvgeny Sikachev proposed openstack/sahara: [WIP] Run several edp jobs flows  https://review.openstack.org/22668815:10
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add ability running tests on exist cluster  https://review.openstack.org/22585415:18
dhellmannSergeyLukjanov and other sahara cores: There is some discussion of how to fix the tempest jobs for saharaclient in the qa channel starting at http://eavesdrop.openstack.org/irclogs/%23openstack-qa/%23openstack-qa.2015-09-23.log.html#t2015-09-23T15:04:5215:22
elmikodhellmann: ack, thanks. i'll give it a read through15:23
dhellmannelmiko: thanks, I sent the same details to the -dev list as well15:25
*** AndreyPavlov has quit IRC15:25
openstackgerritSergey Reshetnyak proposed openstack/python-saharaclient: [WIP] Fix functional tests  https://review.openstack.org/22682815:26
rickflareerr15:28
rickflarenow heat stack failed15:28
elmikoooph...15:32
rickflareim so close15:32
rickflarethe error is not very descriptive15:32
rickflarejust heat failed and a ID15:32
vgridnevrickflare, which lab do you use?15:32
vgridnevnova-network?15:32
rickflareim using devstack15:32
rickflareif that helps15:33
vgridnevokay15:33
vgridnevcan you attach your localrc with enabled services?15:34
vgridnevis neutron enabled or not?15:34
rickflareI think so15:35
rickflarewhat do you mean localrc15:35
rickflareim sorry im a newbie15:35
vgridnevlocal.conf15:35
rickflarelet me see15:35
*** ashishb has quit IRC15:35
rickflare[[local|localrc]]15:36
rickflareenable_plugin sahara git://git.openstack.org/openstack/sahara15:36
vgridnevin such case it looks like nova-network will be enabled15:37
vgridnevyou need to apply https://review.openstack.org/#/c/226607/ for heat15:38
*** hdd has joined #openstack-sahara15:40
rickflareonce I do that15:40
rickflaredo I need to retart15:40
*** ashishb has joined #openstack-sahara15:40
vgridnevyep, you need to restart heat-engine15:41
vgridnevin the screen15:41
rickflarehow do I do that15:41
vgridnev./rejoin-stack.sh15:41
vgridnevscreen will be opened15:42
rickflarei got egafford helping to check15:42
rickflarehe says im using neutron15:43
rickflareper my local.conf15:43
vgridnevthis is the only line from local.conf, right? enable_plugin sahara git://git.openstack.org/openstack/sahara ?15:43
rickflareno15:44
rickflarei have lots more15:44
rickflarelet me put it in pastebin15:44
vgridnevok15:44
rickflarehttp://pastebin.com/Qy65iS5w15:45
egaffordvgridnev: I gave rickflare a local.conf with heat and neutron enabled, as I think heat isn't by default in devstack anymore.15:45
egafford(Or at least it wasn't last time that issue made me update my local.conf.)15:45
*** ashishb has quit IRC15:46
openstackgerritMichael McCune proposed openstack/sahara-image-elements: update swift_hadoop element  https://review.openstack.org/22685415:46
elmikopino|work: would love your opinion on that ^15:46
vgridnevegafford, heat is not by default15:46
egaffordvgridnev: Yup.15:47
vgridnevrickflare, I think that we need heat-engine logs to understand reasons of problems15:51
vgridnevCan you attach some stacktraces?15:52
rickflareyes give me like 15min15:52
*** esikachev has quit IRC15:54
pino|workelmiko: done15:55
vgridnevok, I will probably unavailable I future hour or two, maybe some other folks will help you15:55
elmikopino|work: thanks!15:57
pino|workelmiko: nothing bad, after all15:57
*** vgridnev has quit IRC15:57
elmikopino|work: yea, and i was actually curious about using DIB_15:57
*** nkrinner has quit IRC15:57
openstackgerritMichael McCune proposed openstack/sahara-image-elements: update swift_hadoop element  https://review.openstack.org/22685415:58
pino|workelmiko: ... and the documentation!15:58
elmikogood point!15:59
pino|workas usual :D15:59
pino|work</modesty>15:59
elmikolooks like the readme was wrong anyway as it uses HDFS_LIB_DIR instead of DIB_HDFS_LIB_DIR ;)15:59
elmikoand it has the wrong default val...16:00
*** apavlov has quit IRC16:05
openstackgerritMichael McCune proposed openstack/sahara-image-elements: update swift_hadoop element  https://review.openstack.org/22685416:05
elmikopino|work: ok, think i got everything now ;)16:07
pino|workreading your addendum triggered me a question16:07
elmiko?16:07
pino|worksince that jar is generated from the sahara-extras repo, there's no way to automate that?16:07
elmikoi think we discussed this before and came to the conclusion that having mirantis host it was the preferred option16:08
elmikobut,16:08
pino|worklike a post-merge job in sahara-extras that rebuild that jar, and publishes it somewhere on tarballs.o.o16:08
elmikoi agree that it would be better to just build it16:08
elmikothat would be cool16:08
pino|workelmiko: catch!16:22
*** ashishb has joined #openstack-sahara16:27
elmikopino|work: did i make another mistake?16:29
pino|workelmiko: catch!... my +1 ;)16:30
elmikoooh =)16:30
elmikoty16:30
*** vgridnev has joined #openstack-sahara16:50
*** raildo is now known as raildo-afk17:25
rickflareanyone know what would cause this error when launching a cluster?     http://pastebin.com/HvQG5cPX17:33
rickflareanyone know what would cause this when launching a instance?17:38
rickflareError: Build of instance 7cf62f3b-10b0-462f-9b3c-796bdd8d6bc3 aborted: Block Device Mapping is Invalid.].17:38
*** raildo-afk is now known as raildo17:41
toskyrickflare: uhm "Message: No valid host was found. There are not enough hosts available."17:49
rickflareyea17:53
toskydoes nova says anything?17:53
tosky(sorry, bbl)17:53
*** tosky has quit IRC17:53
*** vgridnev has quit IRC18:03
*** vgridnev has joined #openstack-sahara18:16
*** vgridnev has quit IRC18:18
*** vgridnev has joined #openstack-sahara18:21
*** vgridnev has quit IRC18:23
openstackgerritSergey Reshetnyak proposed openstack/python-saharaclient: [WIP] Fix functional tests  https://review.openstack.org/22682818:23
*** vgridnev has joined #openstack-sahara18:30
*** vgridnev has quit IRC18:31
*** vgridnev has joined #openstack-sahara18:39
*** sgotliv has joined #openstack-sahara18:40
*** vgridnev has quit IRC18:49
*** vgridnev has joined #openstack-sahara18:52
*** hdd has quit IRC19:16
*** ashishb has quit IRC19:25
*** ashishb has joined #openstack-sahara19:29
vgridnevtmckay, ping19:52
vgridnevI am totally agree that we need some common utils to avoid code duplication, but this time I am trying to avoid that to land this code in liberty-rc119:54
tmckayvgridnev, okay, fair enough20:04
vgridnevI wrote an little message for you at CR20:04
tmckayI saw it.  Agreed, we can make it better in Mitaka.  I wasn't thinking about this being a bug fix20:05
tmckaythanks20:05
*** stevemar has quit IRC20:11
*** stevemar has joined #openstack-sahara20:11
*** stevemar has quit IRC20:13
*** vgridnev has quit IRC20:27
*** vgridnev has joined #openstack-sahara20:31
*** vkmc is now known as vkmc-afk20:32
*** vgridnev has quit IRC20:38
*** tmckay has quit IRC20:43
*** raildo is now known as raildo-afk20:53
openstackgerritSergey Reshetnyak proposed openstack/python-saharaclient: Fix functional tests  https://review.openstack.org/22682820:55
*** crobertsrh is now known as _crobertsrh20:57
openstackgerritSergey Reshetnyak proposed openstack/python-saharaclient: Fix functional tests in saharaclient  https://review.openstack.org/22682821:06
openstackgerritSergey Reshetnyak proposed openstack/sahara: Added scaling support for HDP 2.2 / 2.3  https://review.openstack.org/19308121:14
openstackgerritSergey Reshetnyak proposed openstack/sahara: HA for NameNode and ResourceManager in HDP 2.2  https://review.openstack.org/19755121:20
openstackgerritMerged openstack/sahara: Add keystone and swift url to /etc/hosts  https://review.openstack.org/21668421:34
openstackgerritMerged openstack/sahara: Configurable timeouts for disk preparing  https://review.openstack.org/22623821:42
openstackgerritMerged openstack/sahara: Use xfs for formatting  https://review.openstack.org/22635821:42
openstackgerritMerged openstack/sahara: Fix problem with create cluster w/o internet  https://review.openstack.org/22404821:43
*** vkmc-afk is now known as vkmc21:54
*** ashishb has quit IRC22:01
*** ashishb has joined #openstack-sahara22:01
*** vkmc has quit IRC22:05
*** vkmc has joined #openstack-sahara22:06
*** stevemar has joined #openstack-sahara22:13
*** stevemar has quit IRC22:15
*** openstackgerrit has quit IRC22:16
*** openstackgerrit has joined #openstack-sahara22:16
sreshetnyaklet's merge fix for saharaclient gate https://review.openstack.org/#/c/226828/ :)22:23
*** egafford has quit IRC22:25
elmikosreshetnyak: that one looked ok to me, but i don't know the functional gate well enough22:29
*** witlessb has quit IRC22:33
*** jamielennox is now known as jamielennox|away22:35
*** jose5 has joined #openstack-sahara22:46
*** jose5 has quit IRC22:57
elmikosreshetnyak: done23:00
*** stevemar has joined #openstack-sahara23:13
*** jamielennox|away is now known as jamielennox23:52
« Tuesday, 2015-09-22 Index Thursday, 2015-09-24 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!