Behavioral Changes in Hive

Functional adjustments and behavioral updates for Hive are introduced in Cloudera Runtime 7.1.9 SP2.

CDPD-95732: Metastore property hive.metastore.try.direct.sql.ddl is removed

Previously, the hive.metastore.try.direct.sql.ddl defaults to false for postgres backed database, which makes the metastore use the slow suboptimal way to fetch or manage the metadata, and this property has to work with hive.metastore.try.direct.sql to control whether the metastore should use the direct SQL to manipulate the metadata.

The hive.metastore.try.direct.sql.ddl property is removed, by default metastore with different databases will try using the direct SQL first, fall back to the DataNucleus in case of failure, and set hive.metastore.try.direct.sql to false alone will disable the direct SQL.

CDPD-76414: Increased Batch Sizes for COMPUTE STATS

The COMPUTE STATS query previously failed on tables containing more than 5000 columns. This issue was specific to wide tables and could not be resolved by dropping and rerunning the query.

To resolve this, we enable the batch retrieval or insertion of the object metadata by default value of the hive.metastore.direct.sql.batch.size property is changed from 0 to 1000, and the default value of the metastore.rawstore.batch.size property is changed from -1 to 500. After this change, COMPUTE STATS queries now run successfully on tables with more than 5000 columns.