19. Configure and Start Apache Sqoop

  1. Replace your configuration after upgrading. Copy /etc/sqoop/conf from the template to the conf directory in sqoop hosts.

  2. As the HDFS Service user, upload the Apache Sqoop tarball to HDFS.

    su - hdfs -c "dfs -mkdir -p /hdp/apps/<$version>/sqoop" 
    su - hdfs -c "dfs -chmod -R 555 /hdp/apps/<$version>/sqoop" 
    su - hdfs -c "dfs -chown -R hdfs:hadoop /hdp/apps/<$version>/sqoop" 
    su - hdfs -c "dfs -put /usr/hdp/2.3-<$version>/sqoop/sqoop.tar.gz /hdp/apps/<$version>/sqoop/sqoop.tar.gz" 
    su - hdfs -c "dfs -chmod 444 /hdp/apps/<$version>/sqoop/sqoop.tar.gz"
  3. If you are using the MySQL database as a source or target, then the MySQL connector jar must be updated to 5.1.29 or later.

    Refer to the MySQL web site for information on updating the MySQL connector jar.

  4. Because Sqoop is a client tool with no server component, you will need to run your own jobs to validate the upgrade.

loading table of contents...