What's New in Apache Spark

Learn about the new features of Apache Spark in Cloudera Runtime 7.3.1, its service packs and cumulative hotfixes.

Cloudera Runtime 7.3.1.400 SP2:

There are no new features in this release.

Cloudera Runtime 7.3.1.300 SP1 CHF1:

There are no new features in Spark in this release.

Cloudera Runtime 7.3.1.200 SP1:

Rebase Spark3 to Apache Spark 3.5.4 in Cloudera Runtime.: Spark 3.5.4 is the default Spark version in Cloudera Runtime. Refer to the Apache Spark documentation for more information on changes.

important
Refer to Migrating Spark applications for more information on migrating your existing Spark applications.

Cloudera Runtime 7.3.1.100 CHF1:

There are no new features in Spark in this release.

Cloudera Runtime 7.3.1:

Spark 3 is the default in Cloudera Runtime: Spark 3 is the default Spark version in Cloudera Runtime. Spark 2 has been removed and no longer available in 7.3.1.0

important

Spark 3 contains a large number of changes from Spark 2.

Refer to Upgrading Spark for more information on upgrading Spark clusters to 7.3.1.0, and Migrating Spark applications for more information on migrating your existing Spark applications between versions 2 and 3.