Suspending and resuming Cloudera Data Engineering virtual clusters using the API
Learn about suspending and resuming Cloudera Data Engineering Virtual Clusters (VCs) using the Cloudera Data Engineering API.
To suspend or resume Cloudera Data Engineering VCs, you need to:
- Have
DEAdminrole - Request the
DE_ENABLE_VC_SUSPEND_RESUMEentitlement - Get the base URL
- You can obtain the
BASE-URLby copying the console URL up to the first forward slash (/).Example for the console URL:
https://console.us-west-1.cdp.cloudera.com/dex/homeAn example for the
BASE-URL, which changes according to the region:https://console.us-west-1.cdp.cloudera.com - Alternatively:
- In the Cloudera Management Console, click the Data Engineering tile.
- In the left navigation menu, click Administration.
- Right click on the Administration page and select Inspect from the list of options.
- Click the Console tab.
- Type
window.location.originand press Enter.
- You can obtain the
- Get the
cdp-session-token(CST)- In the Cloudera Management Console, click the Data Engineering tile.
- In the left navigation menu, click Administration.
- Right click and select Inspect.
- If you use Google Chrome, click the Application tab, or alternatively, if you use Firefox, click the Storage tab.
- Click Cookies and select the URL of the console.
- Select
cdp-session-token. - Double click the displayed cookie value, then right click and select Copy.
- Open a terminal screen.
- Paste the cookie value in the following command and run the command to
get the
cdp-session-token(CST).export CST=[***COOKIE-VALUE***]
The virtual cluster-level suspend and resume feature is implemented as a convenient, user-friendly, one-step procedure. Learn about the procedures that are performed when you suspend and resume a virtual cluster.
- When you suspend a VC
-
- When a VC is suspended, the VC is transitioned to maintenance mode,
where:
- The VC is locked
- Running jobs and sessions are killed
- Job schedules are paused
- The suspend operation is started by scaling down all the
infrastructure deployments of the given VC.
Depending on the distribution of the pods, the associated node can be released.
- When a VC is suspended, the VC is transitioned to maintenance mode,
where:
- When you resume a VC
-
- During the resume operation, first the VC is resumed.
- The VC exits maintenance mode, which involves:
- Unpausing all the job schedules
- Unlocking the VC
