HDFS Administration Guide
Also available as:
PDF
loading table of contents...

Sqoop

Following are considerations for using Sqoop to import or export HDFS-encrypted data.

Recommendations

  • For Hive:

    Make sure that you are using Sqoop with the --target-dir parameter set to a directory that is inside the Hive encryption zone. Specify the -D option after sqoop import.

    For example:

    sqoop import \

    -D sqoop.test.import.rootDir=<root-directory> \

    --target-dir <directory-inside-encryption-zone> \

    <additional-arguments>

  • For append or incremental import:

    Make sure that the sqoop.test.import.rootDir property points to the encryption zone specified in the --target-dir argument.

  • For HCatalog:

    No special configuration is required.