Enabling quota management in CDW Private Cloud

By enabling quota management in Cloudera Data Warehouse (CDW) on Private Cloud, you can assign quota-managed resource pools for environments, Data Catalogs, Virtual Warehouses, and Data Visualization instances.

A namespace is created when you create a Database Catalog or a Virtual Warehouse. At this stage, a resource pool is created with the necessary resources under the selected parent resource pool. You can view the resource pools on the Resource Utilization page by going to the Management Console > Resource Utilization > Quotas tab. Virtual Warehouse namespaces always reserve enough resources to run at least one executor group.

If you have configured auto-scaling of the executor groups for a Hive or an Impala Virtual Warehouse and the Virtual Warehouse needs to schedule more executors for the current load, then CDW tries to increase its resource pool’s quota. If the requested resource pool quota exceeds the parent resource pool’s quota, then auto-scaling fails. However, CDW does not display an error. Cloudera recommends that you reserve quotas proportional to the maximum number of executor groups you plan to deploy during auto-scaling.

When a Virtual Warehouse scales down, CDW lowers the quota on the Virtual Warehouse’s resource pool after downscaling. The Virtual Warehouses, even in the suspended state, will have enough resources to contain one executor group.

You must have created and defined the resource pools that define resource limits in the Management Console, as described in Managing cluster resources using Quota Management.

  1. Log in to CDW as DWAdmin.
  2. Go to Advanced Configuration and select the Enable quota management option.
  3. Click Update.
You can now select the quotas from the Resource Pool drop-down menu on the Activate Environment dialog box.