Compatibility for Cloudera Data Engineering and Cloudera Runtime components

Learn about Cloudera Data Engineering and compatibility for Cloudera Runtime components across different versions.

Cloudera Data Engineering 1.5.5

Table 1. Cloudera Data Engineering compatibility with Cloudera Runtime component details for Security Hardened

Cloudera Runtime Version	Spark 3.2.x	Spark 3.3.x	Spark 3.5.x	Airflow	Iceberg	Kubernetes
7.1.7 SP 3	Spark 3.2.3 Scala 2.12.15 Python 3.9.22 Java 11.0.27	NA	NA	Airflow 2.10.4 Python 3.11.12 Java 17.0.15	Iceberg 0.14.1	1.30
7.1.9 SP1	Spark 3.2.3 Scala 2.12.15 Python 3.9.22 Java 11.0.27	Spark 3.3.2 Scala 2.12.15 Python 3.10.17 Java 17.0.15	NA	Airflow 2.10.4 Python 3.11.12 Java 17.0.15	Iceberg 1.3.0	1.30
7.3.1	NA	NA	Spark 3.5.1 Scala 2.12.18 Python 3.11.13 Java 17.0.15	Airflow 2.10.4 Python 3.11.13 Java 17.0.15	Iceberg 1.5.2	1.30

Table 2. Cloudera Data Engineering compatibility with Cloudera Runtime component details for Redhat insecure

Cloudera Runtime Version	Spark 2.4.x	Spark 3.2.x	Spark 3.3.x	Spark 3.5.x	Airflow	Iceberg	Kubernetes
7.1.7 SP3	Spark 2.4.7 Scala 2.11.12 Python 2.7.18 Python 3.6.8 Java 1.8.0_452	Spark 3.2.3 Scala 2.12.15 Python 2.7.18 Python 3.6.8 Java 11.0.25	NA	NA	Airflow 2.10.4 Python 3.11.12 Java 17.0.15	Iceberg 0.14.1	1.30
7.1.9 SP1	Spark 2.4.7 Spark 2.4.8 Scala 2.11.12 Python 2.7.18 Python 3.6.8 Java 1.8.0_452	Spark 3.2.3 Scala 2.12.15 Python 2.7.18 Python 3.6.8 Java 11.0.25	Spark 3.3.2 Scala 2.12.15 Python 2.7.18 Python 3.8.17 Java 11.0.25	NA	Airflow 2.10.4 Python 3.11.12 Java 17.0.15	Iceberg 1.3.0	1.30
7.3.1	NA	NA	NA	Spark 3.5.1 Scala 2.12.18 Python 2.7.18 Python 3.8.17 Java 11.0.25	Airflow 2.10.4 Python 3.11.13 Java 17.0.15	Iceberg 1.5.2	1.30

Cloudera Data Engineering 1.5.5 SP1

Table 3. Cloudera Data Engineering compatibility with Cloudera Runtime component details for Security Hardened

Cloudera Runtime Version	Spark 3.2.x	Spark 3.3.x	Spark 3.5.x	Airflow	Iceberg	Kubernetes
7.1.7 SP 3	Spark 3.2.3 Scala 2.12.15 Python 3.9.23 Java 11.0.27	NA	NA	Airflow 2.11.0 Python 3.11.14 Java 17.0.16	Iceberg 0.14.1	1.31
7.1.9 SP1	Spark 3.2.3 Scala 2.12.15 Python 3.9.23 Java 11.0.27	Spark 3.3.2 Scala 2.12.15 Python 3.10.18 Java 17.0.16	NA	Airflow 2.11.0 Python 3.11.14 Java 17.0.16	Iceberg 1.3.0	1.31
7.3.1	NA	NA	Spark 3.5.4 Scala 2.12.18 Python 3.11.13 Java 17.0.16	Airflow 2.11.0 Python 3.11.14 Java 17.0.16	Iceberg 1.5.2	1.31

Table 4. Cloudera Data Engineering compatibility with Cloudera Runtime component details for Redhat insecure

Cloudera Runtime Version	Spark 2.4.x	Spark 3.2.x	Spark 3.3.x	Airflow	Iceberg	Kubernetes
7.1.7 SP3	Spark 2.4.7 Scala 2.11.12 Python 2.7.18 Python 3.6.8 Java 1.8.0_452	Spark 3.2.3 Scala 2.12.15 Python 2.7.18 Python 3.6.8 Java 11.0.25	NA	Airflow 2.11.0 Python 3.11.14 Java 17.0.16	Iceberg 0.14.1	1.31
7.1.9 SP1	Spark 2.4.7 Spark 2.4.8 Scala 2.11.12 Python 2.7.18 Python 3.6.8 Java 1.8.0_452	Spark 3.2.3 Scala 2.12.15 Python 2.7.18 Python 3.6.8 Java 11.0.25	Spark 3.3.2 Scala 2.12.15 Python 2.7.18 Python 3.8.17 Java 11.0.25	Airflow 2.11.0 Python 3.11.14 Java 17.0.16	Iceberg 1.3.0	1.31

Cloudera Data Engineering 1.5.5 SP2

Table 5. Cloudera Data Engineering compatibility with Cloudera Runtime component details for Security Hardened

Cloudera Runtime Version	Spark 3.3.x	Spark 3.5.x	Airflow	Iceberg	Kubernetes
7.1.9 SP1	Spark 3.3.2 Scala 2.12.15 Python 3.10.19 Java 17.0.17	Spark 3.5.4 Scala 2.12.18 Python 3.11.14 Java 17.0.17	Airflow 2.11.0 Python 3.11.14 Java 17.0.17	Iceberg 1.3.0	1.32
7.3.1	NA	Spark 3.5.4 Scala 2.12.18 Python 3.11.14 Java 17.0.17	Airflow 2.11.0 Python 3.11.14 Java 17.0.17	Iceberg 1.5.2	1.32

Table 6. Cloudera Data Engineering compatibility with Cloudera Runtime component details for Redhat insecure

Cloudera Runtime Version	Spark 2.4.x	Spark 3.3.x	Airflow	Iceberg	Kubernetes
7.1.9 SP1	Spark 2.4.8 Scala 2.11.12 Python 2.7.18 Python 3.6.8 Java 1.8.0_472	Spark 3.3.2 Scala 2.12.15 Python 2.7.18 Python 3.8.17 Java 11.0.25	Airflow 2.11.0 Python 3.11.14 Java 17.0.17	Iceberg 1.3.0	1.32