Spark and Airflow versions for Cloudera Data Engineering Private Cloud
Cloudera Data Engineering (CDE) uses Spark and Airflow as its components. The following table lists the versions of Airflow and Spark in this release:
Component | Version |
---|---|
Spark | 2.4.7, 2.4.8, 3.2.3, and 3.3.2 |
Airflow | 2.6.3 |
Spark version compatibility with CDP Private Cloud Base
CDP Private Cloud Base | Spark Version |
---|---|
7.1.7 | 2.4.7 and 3.2.3 |
7.1.8 | 2.4.7 and 3.2.3 |
7.1.9 | 2.4.7, 2.4.8, 3.2.3, and 3.3.2 |