Upgrading Apache Spark 2.4.7 (with CDS 3.2.3) on 7.1.7 SP3 to Spark 3 on 7.3.1
The following steps will help you upgrading from Apache Spark 2.4.7 (with CDS 3.2.3) on Cloudera Private Cloud 7.1.7 SP3 to Spark 3.4.1 on 7.3.1.
Source cluster version | Source cluster Spark 2 version | Source cluster Spark 3 version | Target cluster version | Target cluster Spark 3 version | Spark 2 used with connectors1 |
---|---|---|---|---|---|
7.1.7 SP3 | 2.4.7 | 3.2.3 (CDS) | 7.3.1 | 3.4.1 | yes |
Intermediate in-place cluster upgrade
1 Oozie, Solr, Phoenix, Hive Warehouse Connector, Spark Schema Registry