Compatibility for Cloudera AI 1.5.5 SP4, Cloudera Runtime components and Data Visualization

Explore Cloudera AI 1.5.5 SP4 and its compatibility with Cloudera Runtime components and with Cloudera Data Visualization across various versions.

important

If you switch from the Red Hat Universal Base Image (Redhat UBI image) to the security hardened image, note that the updated component versions and libraries can impact the Cloudera AI operation. Cloudera strongly recommends testing the new implementation in a non-production environment first.
For backward compatibility, you can continue using the Redhat UBI image. The security hardened image is the recommended image; however, note that it requires testing and validation.
For more information, see Security hardened Spark image migration guide.
From Cloudera Data Services on premises 1.5.5 onwards, Spark 3.4 is no longer available.
Hive Warehouse Connector (HWC) is supported on all Spark 2.x versions. However, on Spark 3.x versions, HWC is supported on Spark 3.3.2 and higher.

Cloudera AI version

The following table lists the supported Cloudera AI versions for each Cloudera Data Services on premises release.

Table 1. Cloudera AI versions for each Cloudera Data Services on premises release
Cloudera Data Services on premises version	Cloudera AI version
1.5.5 SP4	Cloudera AI Workbench: 2.1.1-b41 Cloudera AI Registry: 1.18.1-b9 Cloudera AI Inference service: 1.15.1-b29

The following table displays the compatibility between Cloudera Runtime components and Cloudera AI.

Table 2. Cloudera AI compatibility with Cloudera Runtime component details and with Cloudera Data Visualization for security hardened image and for Redhat insecure image
Cloudera Runtime Version	Spark 2.4.x^¹	Spark 3.3.x	Spark 3.5.x	Airflow	Iceberg	Kubernetes	Cloudera Data Visualization (Data tab)
7.1.9 SP2	Spark 2.4.8 ^¹ Scala 2.11.12 ^¹ Python 2.7.18 ^¹ Python 3.6.8 ^¹ Java 1.8.0_492 ^¹	Spark 3.3.2 Scala 2.12.15 Python 2.7.18 ^¹ Python 3.8.17 ^¹ Python 3.10.20 Java 11.0.25 ^¹ Java 17.0.19	Spark 3.5.4 Scala 2.12.18 Python 3.11.16 Java 17.0.20	Airflow 2.11.2 Python 3.11.16 Java 17.0.20	Iceberg 1.3.0	1.34	8.1.4.1000-4
7.3.1		NA	Spark 3.5.4 Scala 2.12.18 Python 3.11.16 Java 17.0.20	Airflow 2.11.2 Python 3.11.16 Java 17.0.20	Iceberg 1.5.2	1.34	8.1.4.1000-4
7.3.2		NA	Spark 3.5.4 Scala 2.12.19 Python 3.11.16 Java 17.0.20	Airflow 2.11.2 Python 3.11.16 Java 17.0.20	Iceberg 1.5.2	1.34	8.1.4.1000-4

¹ This component is not compatible with security hardened images.