Spark GPU Runtime Images
The Cloudera Spark GPU Runtime uses the "nvidia/cuda" option as a base image. The Spark RAPIDS is built against Cloudera Spark distribution and is compatible with the Spark version that Cloudera offers.
The following table provides information about the Spark GPU Runtime images.
Type | CDP Base version | CUDA Version | Base Image | Spark GPU Runtime |
---|---|---|---|---|
Job | 7.1.7 | CUDA 12.1.1 | nvidia/cuda:12.1.1-base-ubi8 | dex-spark-runtime-gpu-3.2.3-7.1.7.2035:1.20.1-b48 |
Job | 7.1.9 | CUDA 12.1.1 | nvidia/cuda:12.1.1-base-ubi8 | dex-spark-runtime-gpu-3.3.2-7.1.9.0:1.20.1-b48 |
Session | 7.1.7 | CUDA 12.1.1 | nvidia/cuda:12.1.1-base-ubi8 | dex-livy-runtime-gpu-3.2.3-7.1.7.2035:1.20.1-b48 |
Session | 7.1.9 | CUDA 12.1.1 | nvidia/cuda:12.1.1-base-ubi8 | dex-livy-runtime-gpu-3.3.2-7.1.9.0:1.20.1-b48 |