Behavioral Changes in Spark

Behavioral changes denote a marked change in behavior from the previously released version to this version of Spark.

Behavioral changes in Cloudera Runtime 7.3.1.400 SP2

There are no behavioral changes in this release.

There are no behavioral changes in this release.

Summary:: Rebase Spark3 to Apache Spark 3.5.4 in Cloudera Runtime.; Previous behavior:; Spark 3.4.1 was the default version in Cloudera Runtime.; New behavior:; Spark 3.5.4 is the default Spark version in Cloudera Runtime.

important
Refer to Migrating Spark applications for more information on migrating your existing Spark applications.

There are no behavioral changes in this release.

Summary:: Spark 2 has been removed from Cloudera Runtime.; Previous behavior:; Spark 2 was the default version in Cloudera Runtime, Spark 3 was available as an add-on parcel.; New behavior:; Spark 3 is the default Spark version in Cloudera Runtime. Spark 2 has been removed and no longer available in 7.3.1.0.

important

Spark 3 contains a large number of changes from Spark 2.

Refer to Upgrading Spark for more information on upgrading Spark clusters to 7.3.1.0, and Migrating Spark applications for more information on migrating your existing Spark applications between versions 2 and 3.