Compatibility for Cloudera Data Engineering and Runtime components
Learn about Cloudera Data Engineering and compatibility for Runtime components across different versions. This document also includes component version compatibility information for AWS Graviton.
Cloudera Data Engineering Version | Spark 2.4.x | Spark 3.2.x | Spark 3.3.x | Spark 3.5.x | Airflow | Kubernetes |
---|---|---|---|---|---|---|
1.23.1 |
|
|
|
|
|
1.30 |
1.23.0 |
|
|
|
|
|
1.30 |
1.22.0 |
|
|
|
|
|
1.28 |
1.21 |
|
|
|
N/A |
|
1.27 |
1.20.3 |
|
|
|
N/A |
|
1.27 |
1.19.4 |
|
|
|
N/A |
|
1.26 |
1.19.3 |
|
|
|
N/A |
|
1.25 |
1.19.2 |
|
|
|
N/A |
|
1.25 |
1.19 |
|
|
|
N/A |
|
1.25 |
1.18.3 |
|
|
N/A | N/A |
|
1.24 |
1.18.1 |
|
|
N/A | N/A |
|
1.23 |
1.18 |
|
|
N/A | N/A |
|
1.23 |
1.17-h1 |
|
|
N/A | N/A |
|
1.23 |
AWS Graviton component version compatibility
To use AWS Graviton in Cloudera Data Engineering, you need the following runtime component versions:
- Spark 3.3 and 3.5
- Data Lake 7.2.18 and 7.3.1