Cloudera Docs

May 20, 2021

This release (1.7) of the Cloudera Data Engineering (CDE) service on CDP Public Cloud introduces the new features and improvements that are described in this topic.

GA support for Microsoft Azure

  • Support for Microsoft Azure is no longer a Technical Preview feature, and is now generally available (GA).

GA support for gang scheduling

  • Gang scheduling is no longer a Technical Preview feature, and is now generally available (GA).
  • For a detailed explanation on gang scheduling, see the blog post.

Diagnostic bundles

  • The Diagnostic page has been enhanced to support granular log selection as well as a snapshot of the service and cluster status.

[Technical Preview] Support for virtual clusters powered by Apache Spark 3

  • You can now create virtual clusters powered by Apache Spark version 3. You cannot use Spark 2 and Spark 3 within the same virtual cluster, but you can have multiple Spark 2 and Spark 3 virtual clusters within the same CDE service.
  • This features is available as a Technical Preview. Contact your Cloudera account representative to enable access to this feature.

[Technical Preview] Bin packing resource scheduling

  • Bin packing is a new Apache Yunikorn resource management policy. Bin packing makes more efficient use of available nodes when assigning executors to hosts.
  • This features is available as a Technical Preview. Contact your Cloudera account representative to enable access to this feature.

Automatic TLS certificate renewal

  • Cluster TLS certificates are now renewed automatically.