HDP-2.4.2 Release Notes
Also available as:
PDF

Hive

HDP 2.4.2 provides Hive 1.2.1 and the following Apache patches:

  • HIVE-11097: HiveInputFormat uses String.startsWith to compare splitPath and PathToAliases.

  • HIVE-11333: ColumnPruner prunes columns of UnionOperator that should be kept.

  • HIVE-11470: NPE in DynamicPartFileRecordWriterContainer on null part-keys..

  • HIVE-11816: Upgrade groovy to 2.4.4.

  • HIVE-11841: KeyValuesInputMerger creates huge logs.

  • HIVE-12022: NPE in SARG with timestamp cast.

  • HIVE-12064: prevent transactional=false.

  • HIVE-12165: wrong result when hive.optimize.sampling.orderby=true with some aggregate functions.

  • HIVE-12189: The list in pushdownPreds of ppd.ExprWalkerInfo should not be allowed to grow very large.

  • HIVE-12352: CompactionTxnHandler.markCleaned() may delete too much.

  • HIVE-12684: NPE in stats annotation when all values in decimal column are NULLs.

  • HIVE-12742: NULL table comparison within CASE does not work as previous hive versions.

  • HIVE-12749: Constant propagate returns string values in incorrect format.

  • HIVE-12784: Group by SemanticException: Invalid column reference.

  • HIVE-12879: RowResolver of Semijoin not updated in CalcitePlanner.

  • HIVE-12947: SMB join in tez has ClassCastException when container reuse is on.

  • HIVE-13016: ORC FileDump recovery utility fails in Windows.

  • HIVE-13092: Vectorized java.lang.ClassCastException: org.apache.hadoop.hive.serde2.typeinfo.ListTypeInfo cannot be cast to org.apache.hadoop.hive.serde2.typeinfo.PrimitiveTypeInfo.

  • HIVE-13129: CliService leaks HMS connection.

  • HIVE-13144: HS2 can leak ZK ACL objects when curator retries to create the persistent ephemeral node.

  • HIVE-13151: Clean up UGI objects in FileSystem cache for transactions.

  • HIVE-13174: Remove Vectorizer noise in logs.

  • HIVE-13232: Aggressively drop compression buffers in ORC OutStreams.

  • HIVE-13233: Use min and max values to estimate better stats for comparison operators.

  • HIVE-13263: Vectorization: Unable to vectorize regexp_extract/regexp_replace " Udf: GenericUDFBridge, is not supported".

  • HIVE-13285: Orc concatenation may drop old files from moving to final path.

  • HIVE-13298: nested join support causes undecipherable errors in SemanticAnalyzer.

  • HIVE-13325: Excessive logging when ORC PPD fails type conversions.

HDP 2.4.0 provided Hive 1.2.1 and the following Apache patches:

  • HIVE-11141: Improve RuleRegExp when the Expression node stack gets huge.

  • HIVE-11291: Avoid allocation storm while doing rule matching on operator/expression trees.

  • HIVE-11310: Avoid expensive AST tree conversion to String for expressions in WHERE clause.

  • HIVE-11311: Avoid dumping AST tree String in Explain unless necessary.

  • HIVE-11328: Avoid String representation of expression nodes in ConstantPropagateProcFactory unless necessary.

  • HIVE-11330: Add early termination for recursion in StatsRulesProcFactory.evaluateExpression.

  • HIVE-11397: Parse Hive OR clauses as they are written into the AST.

  • HIVE-11405: Add early termination for recursion in StatsRulesProcFactory.evaluateExpression for OR expression.

  • HIVE-11406: Vectorization: StringExpr::compare() == 0 is bad for performance.

  • HIVE-11981: ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized).

  • HIVE-12625: Backport to branch-1 HIVE-11981 ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized).

  • HIVE-12660: HS2 memory leak with .hiverc file use.

  • HIVE-12706: Incorrect output from from_utc_timestamp()/to_utc_timestamp when local timezone has DST.

  • HIVE-12728: Apply DDL restrictions for ORC schema evolution.

  • HIVE-12766: TezTask does not close DagClient after execution.

  • HIVE-12799: Always use Schema Evolution for ACID.