Behavioral Changes in Spark

Behavioral changes denote a marked change in behavior from the previously released version to this version of Apache Spark.

Summary:: Spark 2 has been removed from Cloudera Runtime.; Previous behavior:; Spark 2 was the default version in Cloudera Runtime, Spark 3 was available as an add-on parcel.; New behavior:; Spark 3 is the default Spark version in Cloudera Runtime. Spark 2 has been removed and no longer available in 7.3.1.0.

important

Spark 3 contains a large number of changes from Spark 2.

Refer to Upgrading Spark for more information on upgrading Spark clusters to 7.3.1.0, and Migrating Spark Applications for more information on migrating your existing Spark applications between versions 2 and 3.