Cloudera Docs

Viewing and managing virtual cluster details

You can view details such as configuration, metrics, and logs for existing virtual clusters. You can also view jobs associated with a cluster, clone a cluster, and delete a cluster

To view cluster details:

  1. In the Cloudera console, click the Data Engineering tile. The Cloudera Data Engineering Home page displays.
  2. Click Administration in the left navigation menu. The Administration page displays.
  3. In the Services column, select the environment containing the virtual cluster you want to manage.
  4. In the Virtual Clusters column on the right, click the Cluster Details icon for the virtual cluster you want to manage.
  5. On the Configuration tab, you can view details about the cluster, including the cluster name, Cloudera environment, and the CPU and memory auto-scale ranges.

The virtual cluster Overview page provides details about the virtual cluster, and includes links to several resources, such as the API documentation, and the Jobs API URL. You can switch between the following three tabs to view additional information:

Configuration tab

The Configuration tab lists details about the cluster, including the cluster name, Cloudera environment, and the CPU and memory auto-scale ranges. You can modify the virtual cluster quotas (CPU/memory) dynamically. Cloudera Data Engineering provides an Edit option to make the configuration changes dynamically which may take a few mintutes to update. For more information, see Editing virtual clusters linked below.

Resource Capacity
In the Instance Types section, of the Resource Capacity tab you can enable or disable the Allow job-level instance type overrides option.

Spot instance settings are the default settings at Virtual Cluster (VC) level, however, to enhance flexibility, you have the option to overwrite the defaults on a per-job basis. On the Cloudera Data Engineering UI, the Job-level Instance Type Override feature [Technical Preview] is available in the Unified Jobs UI, but not in the Legacy Jobs UI.

  • You can access the Unified Jobs UI by selecting Jobs from the left navigation menu of the Cloudera Data Engineering UI.
  • You can access the Legacy Jobs UI from the Virtual Cluster Details option by clicking the View Jobs button.

If you enable or disable the Allow job-level instance type overrides option, the Override - Enabled or the Override - Disabled label is displayed respectively in the Jobs > Create Job > Advanced Configuration > Compute Configuration > On-Demand/Spot Settings section.

User Access Management
The User Access Management tab displays the Access Management that you can set for the virtual cluster. See Applying user and group access for virtual clusters for more details.

Monitoring tab

Logs
The Logs tab displays the latest log entries for the virtual cluster.
Charts
The Charts tab displays charts of virtual cluster metrics, such as network and filesystem usage.