CDP Public Cloud: September 2023 Release Summary

Data Engineering

This release (1.19.3) of the Cloudera Data Engineering (CDE) service on CDP Public Cloud introduces the following new features:

Support for Spark 3.3 runtimes

CDE supports Spark 3.3. Note that Spark 3.3.0 is supported on Data Lake 7.2.15. For more information, see Cloudera Data Engineering and Data Lake compatibility.

Support for semi-private network for AWS and fully private network for AKS (Preview)

CDE now supports semi-private network for Amazon Web Services (AWS) and fully private network Azure Kubernetes Service (AKS) with Cluster Connectivity Manager v 2 (CCMv2). For more information, see Enabling a Cloudera Data Engineering service, Enabling a semi-private network on AWS, Enabling a fully private network for a CDE service for Azure (Preview), and Cluster Connectivity Manager.

Management Console

This release of the Management Console service introduces the following changes:

Support for il-central-1 AWS region

Tel Aviv (il-central-1) AWS region is now supported. You can register CDP environments and provision Data Hubs in that region. See updated Supported AWS regions.

Audit event archiving for GCP

You can now configure audit event archiving for Google Cloud Platform. For more information, see GCP setup for audit archiving.

Operational Database

Cloudera Operational Database (COD) 1.35 version supports rolling operating system upgrade and enhancements to the CDP CLI.

Rolling operating system upgrades of a COD cluster

COD using HDFS and Object Store without Ephemeral Storage, now supports upgrading the operating system version of the database using the rolling restart mode. This ensures continuous service availability during an upgrade operation. In CDP CLI, you need to use the --os-upgrade-only option along with the --rolling-upgrade option in the upgrade-database command. For more information, see Performing a Cloudera operating system upgrade.

New CDP CLI option --storage-type in the create-database command

In CDP CLI, a new option --storage-type in the create-database command is introduced that replaces the [--use-hdfs | --no-use-hdfs] and [--disable-ephemeral-storage | --no-disable-ephemeral-storage] options. The --storage-type option supports these values, CLOUD_WITH_EPHEMERAL, CLOUD, and HDFS. For more information, see CDP CLI Beta.

COD drops support for Cloudera Runtime 7.2.12 and earlier

COD has stopped supporting the Cloudera Runtime versions 7.2.12 and earlier because they have reached the end of life.