Cloudera Docs

What's new in Cloudera Data Engineering Private Cloud

This release of Cloudera Data Engineering (CDE) on CDP Private Cloud 1.5.3 includes the following feature:

Support for Spark 3.4 on CDP Base 7.1.8

CDE supports using the Spark 3.4 version when creating a virtual cluster on CDP Base 7.1.8. For more information, see Compatibility for Cloudera Data Engineering and Runtime components.

The following connectors are certified for Spark 3.4 on 7.1.8:
  • HDFS - reading and writing HDFS tables

  • Hive table Parquet storage - reading and writing Hive tables

  • Hive table ORC storage - reading and writing Hive tables

  • Ranger - table-level access controls

Kubernetes 1.26 support

  • CDE now supports Kubernetes 1.26.
  • You can upgrade to the Kubernetes 1.26 cluster through the CDE supported upgrade path.