Wednesday, 15 August 2012

How to schedule sqoop job command using oozie in azure hdinsight(remote machine) -



How to schedule sqoop job command using oozie in azure hdinsight(remote machine) -

i trying schedule sqoop job using oozie in hdinsight(remote machine). have executed sqoop job command in cmd , trying schedule "job --exec job1" in oozie. not working. seen logs in azure blob , oozie logs there no error. seen success in yarn app , oozie shows failure/killed1 error.

if running same command in cmd works well.

this sqoop job command : sqoop job --create job1 -- import --connect "jdbc:sqlserver://<ip:port>;database=<dbname>;username=<name>;password=<pwd>" --table tablename --target-dir /example/sqoopoutput --incremental append --check-column latestdate --last-value "1991-01-01 00:00:00.000" getting error : [org.apache.oozie.action.hadoop.sqoopmain], exit code [1]

i tried jar files in sqoop , oozie share lib jars.

while scheduling sqoop job in oozie not leave space in date value passed, instead of space utilize t

change command follows :

job --create job1 -- import --connect "jdbc:sqlserver://<ip:port>;database=<dbname>;username=<name>;password=<pwd>" --table tablename --target-dir /example/sqoopoutput --incremental append --check-column latestdate --last-value "1991-01-01t00:00:00.000"

azure sqoop oozie hdinsight

No comments:

Post a Comment