API Compatibility changes in 7.3.2 for Spark

Removed or Modified APIs in Cloudera Runtime 7.3.2 for Spark and recommendations for how to handle them.

Apache Version of Spark in 7.3.1 was 3.5.4 and Apache Version of Spark in 7.3.2 is 3.5.4

Removed APIs in 7.3.2

The following APIs are no longer available for Spark in Cloudera Runtime 7.3.2

ShuffleExchangeExec.prepareShuffleDependency

Method Removed

Package Name
org.apache.spark.sql.execution.exchange
Effect
A client program may be interrupted by NoSuchMethodError exception.
Reason for change
SPARK-51016
Recommendation
None
Recompilation Required?
Yes