Command Line Installation
Also available as:
PDF
loading table of contents...

Set Up the Sqoop Configuration

This section describes how to set up and edit the deployment configuration files for Sqoop. Hortonworks provides a set of configuration files that represent a working Sqoop configuration. (See Download Companion Files. You can use these files as a reference point, however, you need to modify them to match your own cluster environment. If you choose to use the provided configuration files to set up your Sqoop environment, complete the following steps to set up the Sqoop configuration files:

  1. Extract the Sqoop configuration files to a temporary directory. The files are located in the configuration_files/sqoop directory where you decompressed the companion files.

  2. Modify the configuration files.

    In the temporary directory, locate the following files and modify the properties based on your environment.

    Also in sqoop-env.sh, make the following changes:

    • export HADOOP_HOME=${HADOOP_HOME:-/usr/hdp/current/hadoop-client}

    • export HBASE_HOME=${HBASE_HOME:-/usr/hdp/current/hbase-client}

    • export HIVE_HOME=${{HIVE_HOME:-/usr/hdp/current/hive-server2}

    • export ZOOCFGDIR=${ZOOCFGDIR:-/etc/zookeeper/conf}

    • Copy all the configuration files to the Sqoop configuration directory, such as /etc/sqoop/conf.

    • Add the following entry to /usr/bin/sqoop:

      export HIVE_HOME=$ {HIVE_HOME:-/usr/hdp/<version>/hive-server2} where <version> is the same HDP version as the other entries in /usr/bin/sqoop