Fixed Issues in Apache Hive

Review the list of Hive issues that are resolved in Cloudera Runtime 7.1.7 SP2.

OPSAPS-58664: Hive LDAP properties pushed to hive-site.xml

After setting LDAP properties in Hive on Tez service, the configurations are not pushed into the hive-site.xml for Hive on Tez service even after a restart.

This issue is now fixed.

OPSAPS-64585: For a FIPS-enabled cluster, the Beeline client connection fails with an "Invalid keystore format" error

The default Hive JDBC URL in beeline-site.xml does not include the trustStoreType parameter that is required for FIPS-enabled clusters.This makes the URL invalid and connection fails with an "Invalid keystore format" error.

This issue is now fixed by adding "trustStoreType=bcfks" to the JDBC URL in beeline-site.xml for a FIPS-enabled cluster.

CDPD-6010: Thrift version upgraded to 0.13.

CDPD-23454: Thrift version upgraded to 0.14.1 after this patch to avoid CVE.

CDPD-26809: Select with limit returns no rows on non native table. This issue is now fixed.

CDPD-29295: date_format() always returns output in UTC (ignores local timezone).

CDPD-29773: Add/Drop constraints statements are now authorized in HS2.

CDPD-28808: Fix from_unixtime() to consider leap seconds.

CDPD-31811: cron-utils dependency is upgraded to 9.1.6 version.

CDPD-32127: The columnName was escaped twice in ColumnStatsSemanticAnalyzer at line 261, which was causing ParseException. The issue was fixed by not escaping the columnName the second time.

CDPD-32927: Netty3 dependency is removed from Hive.

CDPD-35251: Create table statement based on HbaseStorage handler will not drop underlying HBase table if the create table statement fails.

CDPD-39307: Fix failures when 'transactional_properties' is unset for hive acid tables when using HWC in DIRECT_READER mode.

CDPD-39520: unix_timestamp() is ignoring the time zone value and gives wrong result when the input is of type string.

CDPD-40476: Fix case-insensitivity of window functions in vectorized execution.

CDPD-40779: Upgraded netty to 4.1.77 to fix CVEs.

CDPD-42446: Upgrade com.ibm.icu:icu4j to 69.1 to avoid potential vulnerabilities.

CDPD-42804: Fix the HivePrivilegeObjects for Alter Table Rename Command.

CDPD-42805: User without write permission should not able to use Alter Table Rename command to write to database.

CDPD-42878: User with select privileges on the database will not be able to alter table's ownership.

CDPD-42910: Fix for Spark write failure to Iceberg (StorageHandler) table due to authorization failure

CDPD-43010: Default value of "hive.server2.tez.initialize.default.sessions" is changed to false. The reason for this change is, as default value of hive.server2.tez.sessions.per.default.queue=1 so if multiple queries are executed, user will be seeing performance degradation. Queries may take longer time to execute as there is only one parallel execution happening at the time.

So when you enable the value of "hive.server2.tez.initialize.default.sessions" as true, they can update the value of "hive.server2.tez.sessions.per.default.queue" as well, depending on the resource availability and query concurrency/load on the server.

CDPD-43170: With queue access check enabled, stats gathering in compaction are failing with GSSException. Revert HIVE-20172 - otherwise worker threads running in HS2 is creating embedded HMS & HikariPool to backend DB.

CDPD-43175: Changed default value of hive.optimize.sort.dynamic.partition.threshold to -1.

CDPD-43445: Upgraded spring framework to 5.3.21 due to CVEs

CDPD-43475: Upgraded Apache Ant to 1.10.12 version to fix some CVEs.

CDPD-43485: Upgraded bouncy castle to 1.70 to fix CVEs.

CDPD-43487: Upgraded gson to 2.9.0 to fix CVEs.

CDPD-43490: Upgraded jackson-databind to 2.12.7.1 to fix CVEs.

CDPD-43496: Upgraded velocity to 2.3 to fix CVEs.

CDPD-43498: Upgrade commons-io to 2.11 to fix CVEs.

CDPD-43504: Upgraded PostgreSQL to 42.2.26 / 42.4.1. Fixed CVE-2022-31197

CDPD-43509: Removed dom4j to fix CVEs.

CDPD-43510: Upgraded scala to 2.11.12 to fix CVEs.

CDPD-43511: Upgraded xerces2 to 2.12.2 to fix CVEs.

CDPD-43540: Upgraded jersey to 2.36 to fix CVEs.

CDPD-43754: Before this fix if HIVE_COMPACTOR_COMPACT_MM property was disabled, compaction would be initiated for insert_only tables and fail in MR based compaction, which is not implemented for mm tables

This fix disables compaction for insert only tables if HIVE_COMPACTOR_COMPACT_MM is disabled.

CDPD-44327: sql() API must return empty resultset for insert / update queries.

CDPD-44904: df.write using HWC throws an error if the order of DF columns is different than order of Hive table columns.

CDPD-44982: testSubmitSameFragment test issue has been fixed

CDPD-45001: Support for explain ddl statement. This feature is useful for debugging and fixing problems around query compilation and execution in HiveServer2.

CDPD-45002: Currently 'SHOW CREATE TABLE' doesn’t pull any constraint information like not null, defaults, or primary key. This is fixed by adding constraints in the result of 'SHOW CREATE TABLE' statement.

CDPD-45052: Added versionless symlinks for the hive-warehouse-connector-assembly.jar file.

CDPD-45056: Added versionless symlinks for the pyspark_hwc.zip file.

CDPD-45199: Disable Strict Filtering and excluded reload4j jars from some places to prepare for hadoop to switch to reload4j.

CDPD-45448: Optimize query plan by replacing sections known never produces rows by a Values operator not containing any tuples.

CDPD-45457: testSubmitSameFragment test failure fixed.

CDPD-45788: HWC: Add commitTxn support in pyspark.

CDPD-45572: Upgraded Jettison package to 1.5.1 to fix some CVEs.

CDPD-46568: Upgraded apache ivy to 2.5.1 to fix CVEs.

CDPD-46626: testSubmitSameFragment test issue is fixed.

CDPD-46664: Upgraded commons-codec to 1.15 to fix CVEs.

CDPD-47074: Use the column names in result schema specified by the user when query plan can be simplified to Values operator.