Upgrading HDP Manually
Also available as:
PDF
loading table of contents...

Configure and Start Apache Sqoop

Before you can upgrade Apache Sqoop, you must have first upgraded your HDP components to the latest version (in this case, 2.4.0). This section assumes that you have already upgraded your components for HDP 2.4.0. If you have not already completed these steps, return to Getting Ready to Upgrade and Upgrade 2.0 Components for instructions on how to upgrade your HDP components to 2.4.0.

[Note]Note

The su commands in this section use keywords to represent the Service user. For example, "hdfs" is used to represent the HDFS Service user. If you are using another name for your Service users, you will need to substitute your Service user name in each of the su commands.

  1. Replace your configuration after upgrading. Copy /etc/sqoop/conf from the template to the conf directory in sqoop hosts.

  2. Upload the Sqoop tarball to HDFS. As the <HDFS_User>, for example 'hdfs':

    su - hdfs -c "hdfs dfs -mkdir -p /hdp/apps/2.4.0.0-$BUILD/sqoop"

    su - hdfs -c "hdfs dfs -chmod -R 555 /hdp/apps/2.4.0.0-$BUILD/sqoop"

    su - hdfs -c "hdfs dfs -chown -R hdfs:hadoop /hdp/apps/2.4.0.0-$BUILD/sqoop"

    su - hdfs -c "hdfs dfs -put /usr/hdp/2.4.0.0-$BUILD/sqoop/sqoop.tar.gz /hdp/apps/2.4.0.0-$BUILD/sqoop/sqoop.tar.gz"

    su - hdfs -c "hdfs dfs -chmod 444 /hdp/apps/2.4.0.0-$BUILD/sqoop/sqoop.tar.gz" hdfs

  3. To validate the Sqoop upgrade, run the following command. You should see the Sqoop version information displayed.

    sqoop version | grep 'Sqoop [0-9].*'

    Because Sqoop is a client tool with no server component, you will need to run your own jobs to further validate the upgrade.