Low resource mode requirements
Review the requirements needed to run Cloudera Data Warehouse (CDW) service on Red Hat OpenShift 4.6 and Embedded Container Service (ECS) clusters using the low resource mode. This mode reduces the minimum amount of hardware needed.
- CDP Cloudera Manager must be installed and running.
- CDP Private Cloud must be installed and running. See Installing on OpenShift and Installing on ECS for more details.
- An environment must have been registered with Management Console on the private cloud. See CDP Private Cloud Environments for more details.
- In addition to the general requirements, CDW also has the following minimum memory, storage, and hardware requirements for each worker node using the standard resource mode:
| Component | Low resource mode deployment |
|---|---|
| Nodes | 4 |
| CPU | 4 |
| Memory | 48 GB |
| Storage | 3 x 100 GB (SATA) or 2 x 200 GB (SATA) |
| Network Bandwidth | 1 GB/s guaranteed bandwidth to every CDP Private Cloud Base node |
Virtual Warehouse low resource mode resource requirements
The following requirements are in addition to the low resource mode requirements listed in the previous section.
| Component | vCPU | Memory | Local Storage | Number of pods in XSMALL Virtual Warehouse |
|---|---|---|---|---|
| Coordinator (2) | 2 x 0.4 | 2 x 24 GB | 2 x 100 GB | 2 |
| Executor (2) | 2 x 3 | 2 x 24 GB | 2 x 100 GB | 2 |
| Statestore | 0.1 | 512 MB | -- | 1 |
| Catalogd | 0.4 | 16 GB | -- | 1 |
| Auto-scaler | 0.1 | 1 GB | -- | 1 |
| Hue (backend) | 0.5 | 8 GB | -- | 1 |
| Hue (frontend) | -- | -- | -- | 1 |
| Total for XSMALL Virtual Warehouse | 8 (7.9) | 121.5 GB | 400 GB - 3 volumes | -- |
Impala Admission Control Configuration
- Maximum concurrent queries per executor: 4
- Maximum query memory limit: 8 GB
| Component | vCPU | Memory | Local Storage | Number of pods in XSMALL Virtual Warehouse |
|---|---|---|---|---|
| Coordinator (2) | 2 x 1 | 2 x 4 GB | 2 x 100 GB | 2 |
| Executor (2) | 2 x 4 | 2 x 48 GB (16 GB heap; 32 GB off-heap) | 2 x 100 GB | 2 |
| HiveServer2 | 1 | 16 GB | -- | 1 |
| DAS | 0.5 | 4 GB | -- | 1 |
| Hue (backend) | 0.5 | 8 GB | -- | 1 |
| Hue (frontend) | -- | -- | -- | 1 |
| Standalone compute operator | 0.1 | 100 MB (.1 GB) | -- | -- |
| Standalone query executor (separate) | Same as executor | Same as executor | Same as executor | -- |
| Total for XSMALL Virtual Warehouse | 21 (20.6) | 237 GB (236.1) | 400 GB - 4 volumes | -- |
Database Catalog low resource mode requirements
The HiveMetaStore (HMS) and the DAS event processor each use 2 CPUs and 8 GB of memory. Because HMS pods are in High Availability mode, they need a total of 4 CPUs and 16 GB of memory.
Total CPUs required: 6
Total memory required: 24 GB
Data Visualization low resource requirements
| vCPU | Memory | Local Storage | Number of pods in XSMALL Virtual Warehouse |
|---|---|---|---|
| 0.5 | 8 GB | -- | 1 |
Security Requirements
The CDW service requires the "cluster-admin" role on the OpenShift and ECS cluster in order to install correctly. The "cluster-admin" role enables namespace creation and the use of the OpenShift Local Storage Operator for local storage.
