Cloudera Docs

Adding a new Virtual Warehouse

A Virtual Warehouse is an instance of compute resources that is equivalent to a cluster. You learn how to create a new Virtual Warehouse in Cloudera Data Warehouse (CDW) Public Cloud of a size that suits your use case.

A Virtual Warehouse provides access to the data in tables and views in the data lake that correlates to a specific Database Catalog. Virtual Warehouses can only look up the Database Catalog that they have been configured to access.

When you create a Virtual Warehouse, a cluster is created in your cloud provider account. This cluster has two buckets. One bucket is used for managed data and the other is used for external data.

Before you create a new Virtual Warehouse, determine the number of concurrent queries or users your Virtual Warehouse must serve during peak periods. This information helps you determine what size of Virtual Warehouse you need. Choose the size based on the number of executors you typically use for clusters in an on-premises deployment. Also consider the complexity of your queries and the size of the data sets that they access. Larger sized warehouses with more executors can cache more data, which enhances performance.

Virtual Warehouse sizes you can choose from:

Virtual Warehouse Size Number of Executors
XSMALL 2
SMALL 10
MEDIUM 20
LARGE 40
Custom Enter a value between '1' and '100'

Required role: DWAdmin

You must enable the entitlement CDW_VERSIONED_DEPLOY to select the image version in step 6.
  1. Log in to the CDP web interface and navigate to the Data Warehouse service.
  2. Click Virtual Warehouses.
  3. In Virtual Warehouses, click Add New.
  4. In New Virtual Warehouse, specify a Name, its Type (Hive or Impala), which Database Catalog it queries,User Groups that can access endpoints, keys and values for Tagging the Virtual Warehouse, and the Size.
  5. Configure auto-scaling thresholds, or accept the defaults, when you specify a Size.
  6. To use Cloudera Data Visualization with this Virtual Warehouse, select Install Data Visualization. For more information about using Data Visualization with CDW, see the link to "Accessing Data Visualization in CDW" in the "Related information" section at the bottom of this page.
  7. In Image Version, select the version of the Cloudera Data Warehouse you want to use, or accept the default version at the top of the dropdown list.
  8. Click Create to create the new Virtual Warehouse.