Apache Spark 3.5.4 Requirements
The following sections describe software and hardware requirements for Spark 3.5.4
Software requirements
Each cluster host must have the following software installed:
- Java
- Cloudera supports JDK 17 for Apache Spark 3.5.4. Remove other JDK versions from all cluster and gateway hosts to ensure proper operation. Refer to Support Matrix for supported Java versions.
- Scala
- Scala 2.12
- Python
- For Spark 3.5.x, use Python 3.8 through 3.11. For version details by Spark release, see Python versions.
For upgrade paths, JDK guidance, and application migration, see Migrating Spark applications.
Hardware requirements
Spark 3 has no specific hardware requirements on top of what is required for Cloudera Runtime deployments.
