Adding a new Virtual Warehouse

A Virtual Warehouse is an instance of compute resources that is equivalent to a cluster. It provides access to the data in tables and views in the data lake that correlates to a specific Database Catalog. Learn how to create a Virtual Warehouse in Cloudera Data Warehouse on premises.

Virtual Warehouses can only lookup the Database Catalog that they have been configured to access.

If you are evaluating Cloudera Data Warehouse or just learning, you can accept the default values. This task shows you how to create a Virtual Warehouse with the bare minimum configurations. You can create Virtual Warehouses with the following SQL engines in Cloudera Data Warehouse:

Hive
Impala
Trino
note
Trino is in Technical Preview and is not ready for production deployments. Cloudera recommends trying this feature in test or development environments and encourages you to provide feedback on your experiences.

Virtual Warehouses can use Hive, Impala, or Trino as the underlying SQL execution engine. Typically, Hive is used to support complex reports and enterprise dashboards, Impala is used to support interactive, ad-hoc analysis, and Trino is used to query large data sets distributed over one or more heterogeneous data sources.

Before you create a Virtual Warehouse in Cloudera Data Warehouse service, you must have completed the following tasks:

Activate your environment for use in Cloudera Data Warehouse.
important
(On OpenShift environments) To activate an environment for the Cloudera Data Warehouse service, someone with adequate permissions must use the Red Hat OpenShift Local Storage Operator to create a local file system on an SSD/NVMe for each OpenShift worker node and then mount it to a known location on the worker node. This creates space for local caching.
On Cloudera Embedded Container Service clusters, Cloudera Data Warehouse automatically creates the local file system. No additional steps are needed.
Grant the DWAdmin role to the user or group that needs to create a Virtual Warehouse. This user or group determines which environment and Database Catalog your Virtual Warehouse uses.
If your cluster is deployed on the OpenShift Container Platform (OCP) and you want to utilize autoscaling capabilities for your Trino Virtual Warehouse, you must install Kubernetes Event-driven Autoscaling (KEDA). KEDA enables dynamic scaling of containers, allowing them to scale up or down based on demand.
note
For Cloudera Embedded Container Service deployments, KEDA is automatically installed in the cluster.

Log in to the Cloudera Data Warehouse service as DWAdmin.
From the Cloudera Data Warehouse Overview page, click the Virtual Warehouses tab and click New Virtual Warehouse.
In the Create Virtual Warehouse drawer, specify a Name for your Virtual Warehouse.

note
The fully qualified domain name of your Virtual Warehouse, which includes the Virtual Warehouse name plus the environment name must not exceed 64 characters; otherwise, Hue cannot load.
Select the Type (Hive, Impala, or Trino) of Virtual Warehouse.
Select the Environment and Database Catalog.
Select the Resource Pool that allows resources to be allocated for the Virtual Warehouse.
Select the Size of your Virtual Warehouse.
Specify settings for the Virtual Warehouse, including auto-suspend, auto-scaling, and query isolation, based on the type of Virtual Warehouse selected.
In the User Groups panel, select a user group to grant access to the Virtual Warehouse.
Select a Kubernetes Resource Template for the Virtual Warehouse.
Click Create Virtual Warehouse to create the new Virtual Warehouse.