Apache Spark 3.4 Requirements

The following sections describe software and hardware requirements for Spark 3.4

Software requirements

Each cluster host must have the following software installed:

Java
JDK 8 or JDK 17. Remove other JDK versions from all cluster and gateway hosts to ensure proper operation.
Scala
Scala 2.12
Python
Python 3.7 and higher

Hardware requirements

Spark 3 has no specific hardware requirements on top of what is required for Cloudera Runtime deployments.