Fixed Issues in Apache Sqoop
Review the list of Sqoop issues that are resolved in Cloudera Runtime 7.2.8.
- CDPD-19934: Sqoop should handle keeping custom environment variables when executing beeline in a new process
- Until now during Hive import when no --hs2-url parameter was specified and Sqoop did the import via the beeline command line utility, in the beeline process launched by Sqoop only the following environment variables were preserved from the parent process: HADOOP_COMMON_HOME, HADOOP_HOME, HADOOP_MAPRED_HOME, HBASE_HOME, HCAT_HOME, HIVE_HOME, JAVA_HOME, PATH, ZOOKEEPER_HOME. Now you can specify custom environment variables to preserve via:
- By specify the "sqoop.beeline.env.preserve" system-property for the Sqoop command. E.g.: sqoop import -Dsqoop.beeline.env.preserve=MY_VARIBALE
- Or by specify the "sqoop.beeline.env.preserve" property as a sqoop-site.xml safety-valve in Cloudera Manager and then it will be applied for every sqoop Hive import.
This issue is now resolved.
- CDPD-21148: Remove Accumulo dependency from Sqoop
- Accumulo support is removed from Sqoop. This issue is now resolved.
- CDPD-18796: In Cloudera Manager, if sqoop.avro.logical_types.decimal.default.precision and sqoop.avro.logical_types.decimal.default.scale are not set correctly for the Sqoop component, the import job fails with the error "Error: java.lang.ArithmeticException: Rounding necessary".
- This issue is now resolved.
- CDPD-19647: When the --query parameter is used with --as-orcfile, Sqoop displays an error.
- This issue is now resolved.
- CDPD-17306: Hive-Common is added as a dependency to Sqoop and Oozie's Sqoop sharelib so that you do not have to do it manually.
- This issue is now resolved.
- CDPD-17843: Hive-JDBC is added as a dependency to Sqoop and Oozie's Sqoop sharelib so you do not have to do it manually.
- This issue is now resolved.
- CDPD-12646: Sqoop does not close the open database connection before submitting the MapReduce Job. The open connection utilizes resources and displays an error message in the log when the connection times out.
- This issue is resolved.
Apache patch information
No additional Apache patches.