Suspending and resuming Cloudera Data Engineering Services - Technical preview

Benefits of suspending your services

Suspending your Services when they are not needed offers significant cost savings, primarily on compute resources, while ensuring your Services remain available when required. During suspension, all Service and Virtual Cluster configurations, as well as jobs, are preserved, similar to hibernating a laptop during idle periods.

For instance, to reduce operational costs, you can suspend your Services during weekends, or overnight on weekdays.

In AWS

Suspending the Service scales down all compute nodes used by the Cloudera Data Engineering Service and its Virtual Clusters (VCs) to zero.

In Azure

The feature stops the AKS cluster during suspension and restarts it when the Service is resumed.

Prerequisites

To suspend and resume your Cloudera Data Engineering Services, you need to:

• Request the DE_ENABLE_SUSPEND_RESUME entitlement
• Have DE Admin user privileges at the environment level

Limitations

The suspend and resume feature has these specific limitations:

• This feature is not available on the Cloudera Data Engineering UI. It is available only through the API and CLI.
• Only scales down compute nodes, application nodes, and base nodes. It does not stop or shut down the Relational Database Service (RDS) or managed database instances.
• Does not allow selective scaling down or suspending specific VCs.
• When you suspend the service, the following operations are not supported:
  • Generating diagnostic bundles; however, you can still download old diagnostic bundles.
  • Generating Grafana charts.

Troubleshooting

If the suspend or resume operation fails, try once again before raising a support ticket.

For more information, see Troubleshooting resume failures.