CDP Public Cloud: September 2023 Release Summary
This release (1.19.3) of the Cloudera Data Engineering (CDE) service on CDP Public Cloud introduces the following new features:
Support for Spark 3.3 runtimes
CDE supports Spark 3.3. Note that Spark 3.3.0 is supported on Data Lake 7.2.15. For more information, see Cloudera Data Engineering and Data Lake compatibility.
Support for semi-private network for AWS and fully private network for AKS (Preview)
CDE now supports semi-private network for Amazon Web Services (AWS) and fully private network Azure Kubernetes Service (AKS) with Cluster Connectivity Manager v 2 (CCMv2). For more information, see Enabling a Cloudera Data Engineering service, Enabling a semi-private network on AWS, Enabling a fully private network for a CDE service for Azure (Preview), and Cluster Connectivity Manager.
This release of the Management Console service introduces the following changes:
Support for il-central-1 AWS region
Tel Aviv (il-central-1) AWS region is now supported. You can register CDP environments and provision Data Hubs in that region. See updated Supported AWS regions.
Audit event archiving for GCP
You can now configure audit event archiving for Google Cloud Platform. For more information, see GCP setup for audit archiving.
Cloudera Operational Database (COD) 1.35 version supports rolling operating system upgrade and enhancements to the CDP CLI.
Rolling operating system upgrades of a COD cluster
COD using HDFS and Object Store without Ephemeral Storage, now supports upgrading the operating system version of the database using the rolling restart mode. This ensures continuous service availability during an upgrade operation. In CDP CLI, you need to use the
--os-upgrade-only option along with the
--rolling-upgrade option in the
upgrade-database command. For more information, see Performing a Cloudera operating system upgrade.
New CDP CLI option
--storage-type in the
In CDP CLI, a new option
--storage-type in the create-database command is introduced that replaces the
[--use-hdfs | --no-use-hdfs] and
[--disable-ephemeral-storage | --no-disable-ephemeral-storage] options. The
--storage-type option supports these values,
CLOUD_WITH_EPHEMERAL, CLOUD, and HDFS. For more information, see CDP CLI Beta.
COD drops support for Cloudera Runtime 7.2.12 and earlier
COD has stopped supporting the Cloudera Runtime versions 7.2.12 and earlier because they have reached the end of life.