Thursday, 13 November 2014

Troubleshooting common hadoop Scoop issues on Cloudera implementation.

 Troubleshooting common hadoop Scoop issues on Cloudera implementation.


Issue 1: Sqoop does not start. Below is the error message:

[hdfs@localhost ~]$ sqoop help
Warning: /opt/cloudera/parcels/CDH-5.0.2-1.cdh5.0.2.p0.13/bin/../lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
/opt/cloudera/parcels/CDH-5.0.2-1.cdh5.0.2.p0.13/bin/../lib/sqoop/bin/sqoop: line 101: /usr/lib/hadoop/bin/hadoop: No such file or directory
/opt/cloudera/parcels/CDH-5.0.2-1.cdh5.0.2.p0.13/bin/../lib/sqoop/bin/sqoop: line 101: exec: /usr/lib/hadoop/bin/hadoop: cannot execute: No such file or directory


Resolution:
a) Set the HADOOP_HOME variable to /opt/cloudera/parcels/CDH/lib/hadoop. you can add a line HADOO_HOME=/opt/cloudera/parcels/CDH/lib/hadoop to your .profile file and that should take care of the path.

export HADOOP_HOME=/opt/cloudera/parcels/CDH/lib/hadoop

b) Other option that I haven't tried is in https://groups.google.com/a/cloudera.org/forum/#!msg/cdh-user/UcGsb_8ALJM/vxWWcwufJ-UJ


Issue 2: Scoop Import command did not work- error could not find the netezza or mysql driver:


Resolution: This is probably sqoop bug that’s fixed in CDH 5.1, The error should be fixed after the upgrade.


In the  sqoop-conf/sqoop-env.sh check the hadoop classpath is configured:
export HADOOP_CLASSPATH=/usr/lib/sqoop/lib/nzjdbc.jar:$HADOOP_CLASSPATH:
and the  jar files are present in  /usr/lib/sqoop/lib/