Spark
HDP 2.3.2 provides Spark 1.4.1 and the following Apache patches:
NEW FEATURES
SPARK-1537 Add integration with Yarn's Application Timeline Server.
SPARK-6112 Provide external block store support through HDFS RAM_DISK.
BUG FIXES
SPARK-10623 NoSuchElementException thrown when ORC predicate push-down is turned on.
HDP 2.3.0 provided Spark 1.3.1 and the following Apache patches:
IMPROVEMENTS
SPARK-7326 (Backport) Performing window() on a WindowedDStream doesn't work all the time JDK 1.7 repackaging