Compatibility for Cloudera Data Engineering and Runtime components
Learn about Cloudera Data Engineering (CDE) and compatibility for Runtime components across different versions. This document also includes component version compatibility information for AWS Graviton.
CDE Version | Spark 2.4.x | Spark 3.2.x | Spark 3.3.x | Spark 3.5.x | Airflow | Kubernetes |
---|---|---|---|---|---|---|
1.22.0 |
|
|
|
|
|
1.28 |
1.21 |
|
|
|
N/A |
|
1.27 |
1.20.3 |
|
|
|
N/A |
|
1.27 |
1.19.4 |
|
|
|
N/A |
|
1.26 |
1.19.3 |
|
|
|
N/A |
|
1.25 |
1.19.2 |
|
|
|
N/A |
|
1.25 |
1.19 |
|
|
|
N/A |
|
1.25 |
1.18.3 |
|
|
N/A | N/A |
|
1.24 |
1.18.1 |
|
|
N/A | N/A |
|
1.23 |
1.18 |
|
|
N/A | N/A |
|
1.23 |
1.17-h1 |
|
|
N/A | N/A |
|
1.23 |
AWS Graviton component version compatibility
To use AWS Graviton in CDE, you need the following runtime component versions:
- Spark 3.3 and 3.5
- Data Lake 7.2.18