Upgrading HDP Manually
Also available as:
PDF
loading table of contents...

Configure and Start Apache Sqoop

[Note]Note

The su commands in this section use keywords to represent the Service user. For example, "hdfs" is used to represent the HDFS Service user. If you are using another name for your Service users, you will need to substitute your Service user name in each of the su commands.

  1. Replace your configuration after upgrading. Copy /etc/sqoop/conf from the template to the conf directory in sqoop hosts.

  2. As the HDFS Service user, upload the Apache Sqoop tarball to HDFS.

    su - hdfs -c "hdfs dfs -mkdir -p /hdp/apps/2.3.0.0-<$version>/sqoop" 
                    
    su - hdfs -c "hdfs dfs -chmod -R 555 /hdp/apps/2.3.0.0-<$version>/sqoop" 
    
    su - hdfs -c "hdfs dfs -chown -R hdfs:hadoop /hdp/apps/2.3.0.0-<$version>/sqoop" 
    
    su - hdfs -c "hdfs dfs -put /usr/hdp/2.3.0.0-<$version>/sqoop/sqoop.tar.gz /hdp/apps/2.3.0.0-<$version>/sqoop/sqoop.tar.gz" 
    
    su - hdfs -c "hdfs dfs -chmod 444 /hdp/apps/2.3.0.0-<$version>/sqoop/sqoop.tar.gz"
  3. If you are using the MySQL database as a source or target, then the MySQL connector jar must be updated to 5.1.29 or later.

    Refer to the MySQL web site for information on updating the MySQL connector jar.

  4. Because Sqoop is a client tool with no server component, you will need to run your own jobs to validate the upgrade.