April 13, 2022

This release 1.15.1 of Cloudera Data Engineering (CDE) on CDP Private Cloud 1.3.4 includes the following features.

For known issues and limitations, see Known issues and limitations in Cloudera Data Engineering.

CDE diagnostic bundles

You can now generate and download diagnostic data of Cloudera Data Engineering for troubleshooting purposes. You can specify the time duration, the associated environments and services, and limit the size of the file to include in the diagnostic data.

For more information, see Working with CDP Private Cloud diagnostic data.

Embedded Grafana dashboards for monitoring virtual clusters

You can now access Grafana dashboards for advanced visualization of Virtual Cluster’s metrics such as memory and CPU usage in Cloudera Data Engineering (CDE) Private Cloud.

For more information, see Connecting to Grafana dashboards.

Access key based authentication

Cloudera Data Engineering (CDE) now supports transparent authentication using a password file, Cloudera Data Platform (CDP) access keys, and CDP credentials file.

For more information, see Getting an API access token and CLI authentication.

Custom Docker runtime images

Support for custom docker runtime images is now GA. Custom dependencies and packages can be included in a docker image built on top of the default CDE Spark runtime. Jobs using custom runtime images can be deployed using the API or the CLI.

For more information, see Using Custom Spark Runtime Docker Images.