Apache Spark upgrades
Upgrading Apache Spark
Upgrading Apache Spark 2 to Spark 3
Upgrading from 7.2.18
Upgrade from Spark 2.4.8
Sidecar migration of Data Hub clusters
Application migration tasks (Spark 2 to 3)
Post-application migration tasks
In-place cluster upgrade
Final steps
Upgrades with Spark 3.4.1 (bundled)
Upgrade from Spark 2.4.8 (with 3.4.1 bundled)
Sidecar migration of Data Hub clusters
Application migration tasks (Spark 2 to 3)
Post-application migration tasks
In-place cluster upgrade
Final steps
Upgrade from Spark 3.4.1 (bundled)
In-place cluster upgrade
Final steps
Upgrading from 7.2.17
Upgrade from Spark 2.4.8
Intermediate in-place cluster upgrade
Sidecar migration of Data Hub clusters
Application migration (Spark 2 to 3)
Post-application migration tasks
In-place cluster upgrade
Application migration tasks (Spark 3.x to 3.4.1)
Final steps
Upgrade from Spark 2.4.8 (with connectors)
Intermediate in-place cluster upgrade
Upgrade from Spark 2.4.8 (with 3.3.2 bundled)
Intermediate in-place cluster upgrade
Intermediate application migration tasks
Sidecar migration of Data Hub clusters
Application migration tasks (Spark 2 to 3)
Post-application migration tasks
In-place cluster upgrade
Application migration tasks (Spark 3.x to 3.4.1)
Final steps
Upgrade from Spark 2.4.8 (with 3.3.2 bundled and connectors)
Intermediate in-place cluster upgrade
Upgrade from Spark 3.3.2
In-place cluster upgrade
Application migration tasks (Spark 3.x to 3.4.1)
Final steps
Upgrading Apache Spark 3.3.x or 3.4.x to Spark 3.5.4
Upgrade Spark 3.3.2 (bundled) to 3.5.4
Spark application migration
In-place cluster upgrade
Final steps
Upgrading Apache Spark 3.4.1 to 3.5.4
Spark application migration
In-place cluster upgrade
Final steps
Migrating Apache Spark applications
Java versions
Scala versions
Python versions
Spark commands
Spark connectors
Logging
Third-party libraries
Spark behavior changes
Migrating Apache Spark applications
Migrating Apache Spark applications
Migrating Apache Spark applications
Apache Spark Migration guides
Spark 2 to Spark 3 workload refactoring
Unsupported features
Post-migration checklist
Benchmark testing
Troubleshooting