Upgrading Apache Spark 3.3.x to Spark 3.5.4

Cluster and application tasks for moving CDS Spark 3.3.x to Apache Spark 3.5.4 on CDP Private Cloud 7.1.9.

Apache Spark 3.5.4 is available on CDP Private Cloud 7.1.9 through the CDS 3.5 parcel. Use this guide when you already run Spark 3.3.x (CDS 3.3) and need to move to Spark 3.5.4 (CDS 3.5) without upgrading your cluster version.

Source cluster version	Source cluster Spark 3 version	Target Spark 3 version	Documentation
7.1.9 SP1	3.3.2 (CDS parcel)	3.5.4 (CDS 3.5 parcel)	Upgrade guide

For application-level changes, see Migrating Spark applications and the topics under Spark behavior changes for Spark 3.5.4.