Behavioral Changes
Behavioral changes denote a marked change in behavior from the previously released version to this version of software. In HDP 2.4.2, behavioral changes affect the following Hadoop components:
| Hortonworks Bug ID | Apache Component | Apache JIRA | Summary | Details |
|---|---|---|---|---|
|
BUG-52381 |
Apache Spark |
Spark Kafka streaming jars dependency |
Developers using Spark Streaming with Apache Kafka on a Kerberos-enabled cluster should use the HDP spark-streaming-kafka jar file and associated jar files. For more information, see Using Spark Streaming with Kafka on a Kerberos-Enabled Cluster in the Spark Guide. | |
|
BUG-55056 |
Apache YARN |
Nodemanager connection errors are retried at multiple levels. |
Scenario: During NodeManager restart, all YARN clients connected to NodeManager need to retry the connection to NodeManager. We formerly had a two layer retry for YARN Client connection with NodeManager: one was at the RPC layer, and the other was at the NodeManager proxy layer. This caused the log of retry activities to expand logarithmically. After this fix, we consolidated the RPC layer retry and NodeManager proxy retry; the retry log no longer has duplicate entries. |