Spark GPU Runtime Images
The Cloudera Spark GPU Runtime uses the nvidia/cuda as a base image. The following table provides information about the Spark GPU Runtime images. The Spark RAPIDS is built against Cloudera Spark distribution and is compatible with the Spark version that Cloudera offers.
Type | CDP Base | CUDA Version | Base Image | Spark GPU Runtime |
---|---|---|---|---|
Job | 7.1.7 | CUDA 12.1.1 | nvidia/cuda:12.1.1-base-ubi8 | dex-spark-runtime-gpu-3.2.3-7.1.7.2035:1.20.1-b48 |
Job | 7.1.9 | CUDA 12.1.1 | nvidia/cuda:12.1.1-base-ubi8 | dex-spark-runtime-gpu-3.3.2-7.1.9.0:1.20.1-b48 |
Session | 7.1.7 | CUDA 12.1.1 | nvidia/cuda:12.1.1-base-ubi8 | dex-livy-runtime-gpu-3.2.3-7.1.7.2035:1.20.1-b48 |
Session | 7.1.9 | CUDA 12.1.1 | nvidia/cuda:12.1.1-base-ubi8 | dex-livy-runtime-gpu-3.3.2-7.1.9.0:1.20.1-b48 |