HDP-2.4.2 Release Notes
Also available as:
PDF

Behavioral Changes

Behavioral changes denote a marked change in behavior from the previously released version to this version of software. In HDP 2.4.2, behavioral changes affect the following Hadoop components:

Hortonworks Bug IDApache ComponentApache JIRASummaryDetails

BUG-52381

Apache Spark

 

Spark Kafka streaming jars dependency

Developers using Spark Streaming with Apache Kafka on a Kerberos-enabled cluster should use the HDP spark-streaming-kafka jar file and associated jar files. For more information, see Using Spark Streaming with Kafka on a Kerberos-Enabled Cluster in the Spark Guide.

BUG-55056

Apache YARN

YARN-4414

Nodemanager connection errors are retried at multiple levels.

Scenario: During NodeManager restart, all YARN clients connected to NodeManager need to retry the connection to NodeManager.

We formerly had a two layer retry for YARN Client connection with NodeManager: one was at the RPC layer, and the other was at the NodeManager proxy layer. This caused the log of retry activities to expand logarithmically. After this fix, we consolidated the RPC layer retry and NodeManager proxy retry; the retry log no longer has duplicate entries.