Upgrading Apache Spark 3.3.x or 3.4.x to Spark 3.5.4

Cluster and application tasks for moving bundled or CDS Spark to Apache Spark 3.5.4 in Cloudera Runtime.

Apache Spark 3.5.4 ships with Cloudera Runtime 7.3.1.100 and higher, and 7.3.2.0. From Cloudera Runtime 7.3.1 onward, Spark 3.4.1 (bundled) is described the same way for Cloudera on premises and for Cloudera on cloud; use the upgrade guide link that matches your documentation set.

For Spark 3.4.1 (bundled) to Spark 3.5.4, see Upgrading Apache Spark 3.4.1 to Spark 3.5.4.

For application-level changes, see Migrating Spark applications and the topics under Spark behavior changes for Spark 3.5.4.