maven - Oozie error while trying to execute "bin/mkdistro.sh -DskipTests" -
trying install oozie 4.0.1 next http://www.thecloudavenue.com/2013/10/installation-and-configuration-of.html hadoop version - 2.4.0 maven - 3.0.4 sqoop - 1.4.4
while trying execute "bin/mkdistro.sh -dskiptests", failed building.......... [info] apache oozie hcatalog libs ........................ success [0.399s] [info] apache oozie core ................................. failure [7.819s] [info] apache oozie docs ................................. skipped ......... [error] failed execute goal on project oozie-core: not resolve dependencies project org.apache.oozie:oozie-core:jar:4.0.0: next artifacts not resolved: org.apache.oozie:oozie-hadoop-test:jar:2.4.0.oozie-4.0.0, org.apache.oozie:oozie-hadoop:jar:2.4.0.oozie-4.0.0, org.apache.oozie:oozie-sharelib-oozie:jar:4.0.0-cdh5.0.2, org.apache.oozie:oozie-sharelib-hcatalog:jar:4.0.0-cdh5.0.2: failure find org.apache.oozie:oozie-hadoop-test:jar:2.4.0.oozie-4.0.0 in htp://repo1.maven.org/maven2 cached in local repository, resolution not reattempted until update interval of central has elapsed or updates forced -> [help 1] [error] [error] see total stack trace of errors, re-run maven -e switch. [error] re-run maven using -x switch enable total debug logging. [error] [error] more info errors , possible solutions, please read next articles: [error] [help 1] htp://cwiki.apache.org/confluence/display/maven/dependencyresolutionexception [error] [error] after correcting problems, can resume build command [error] mvn -rf :oozie-core
anybody tried oozie4.0.1 hadoop 2.4.0? how can solve issue?
me faced same probelm.
try installtion steps worked me alter versions in below steps depends on version need.
step 1 : extract tar file using tar -xvf oozie-4.0.1.tar.gz step 2 : alter name oozie-4.0.1 oozie using below command. mv oozie-4.0.1 oozie step 3 : move oozie/bin directory using cd oozie/bin build oozie hadoop-2.2 using below command. mkdistro.sh -dskiptests dhadoopversion=2 before build oozie must alter versions java, hive pig, sqoop in pom.xml file. java - 1.7 hive - 0.13.0 pig - 0.12.1 sqoop - 1.4.3 eg : <javaversion>1.7</javaversion> <targetjavaversion>1.7</targetjavaversion> <hive.version>0.13.0</hive.version> <pig.version>0.12.1</pig.version> <pig.classifier></pig.classifier> <sqoop.version>1.4.3</sqoop.version> if build success message oozie distro created, date[2014.01.05-18:55:14gmt] vc- rev[unavailable], available @ [/home/labuser/oozie/distro/target] utilize expanded oozie located in /home/labuser/oozie/distro/target/oozie-4.0.1-distro/oozie-4.0.1 step 4 : create libext directory in expanded oozie , re-create hadoop-2.2.0 jar files , extjs zip file libext directory. step 5 : set property in hadoop core-site.xml file. eg : <property> <name>hadoop.proxyuser.labuser.hosts</name> <value>*</value> </property> <property> <name>hadoop.proxyuser.labuser.groups</name> <value>*</value> </property> set property in oozie-site.xml file located in conf directory <name>oozie.service.jpaservice.create.db.schema</name> <value>true</value> default false alter true step 6 : prepare oozie war file. move expanded oozie/bin , run below command. ./oozie-setup.sh prepare-war if error zip: command not found install zip using next command sudo apt-get install zip 1 time again run prepare-war command create file. if war file created message info: oozie ready started step 7 : upload share lib folder expanded oozie hdfs using below command ./oozie-setup.sh sharelib create -fs hdfs://localhost:8020 step 8 : create database oozie using command ./oozie-setup.sh db create –run if database created message setting catalina_opts="$catalina_opts -xmx1024m" validate db connection done check db schema not exist done check oozie_sys table not exist done create sql schema done create oozie_sys table done oozie db has been created oozie version ’4.0.0′ step 9 : start oozie using ./oozied.sh start step 10 : check status of oozie using below command ./oozie admin –oozie http://localhost:11000/oozie -status message scheme mode: normal issues faced installation 1. while building hive-0.13.0 share library of oozie, there unsolvable dependency ‘hive-builtins’. cause: hive-builtins jar necessary in hive-0.10.0 in hive-0.13.0 there no hive-builtins.jar. solution: removed dependency hive-builtins 2. while building oozie, faced issue java.lang.outofmemoryerror cause: error signals jvm running maven has run out of memory. caused maven-compiler-plugin solution: edited maven-compiler-plugin property <fork>true</fork> fork allows running compiler in separate process. if false uses built in compiler, while if true utilize executable. made oozie bulid, above versions of hadoop-ecosystems.
maven hadoop oozie
No comments:
Post a Comment