Troubleshooting common hadoop Scoop issues on Cloudera implementation.
Issue 1: Sqoop does not start. Below is the error message:
[hdfs@localhost ~]$ sqoop help
Warning: /opt/cloudera/parcels/CDH-5.0.2-1.cdh5.0.2.p0.13/bin/../lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
/opt/cloudera/parcels/CDH-5.0.2-1.cdh5.0.2.p0.13/bin/../lib/sqoop/bin/sqoop: line 101: /usr/lib/hadoop/bin/hadoop: No such file or directory
/opt/cloudera/parcels/CDH-5.0.2-1.cdh5.0.2.p0.13/bin/../lib/sqoop/bin/sqoop: line 101: exec: /usr/lib/hadoop/bin/hadoop: cannot execute: No such file or directory
Resolution:
a) Set the HADOOP_HOME variable to /opt/cloudera/parcels/CDH/lib/hadoop. you can add a line HADOO_HOME=/opt/cloudera/parcels/CDH/lib/hadoop to your .profile file and that should take care of the path.
export HADOOP_HOME=/opt/cloudera/parcels/CDH/lib/hadoop
b) Other option that I haven't tried is in https://groups.google.com/a/cloudera.org/forum/#!msg/cdh-user/UcGsb_8ALJM/vxWWcwufJ-UJ
Issue 2: Scoop Import command did not work- error could not find the netezza or mysql driver:
Resolution: This is probably sqoop bug that’s fixed in CDH 5.1, The error should be fixed after the upgrade.
In the sqoop-conf/sqoop-env.sh check the hadoop classpath is configured:
export HADOOP_CLASSPATH=/usr/lib/sqoop/lib/nzjdbc.jar:$HADOOP_CLASSPATH:
and the jar files are present in /usr/lib/sqoop/lib/
No comments:
Post a Comment