Cloudera Data Warehouse hardware requirements

Review the requirements needed to get started with the Cloudera Data Warehouse (CDW) service on Red Hat OpenShift 4.5 clusters.

  • CDP Cloudera Manager must be installed and running.
  • CDP Private Cloud must be installed and running. See Private Cloud Installation Requirements for more details.
  • An environment must have been registered with Management Console on the private cloud. See CDP Private Cloud Environments for more details.
  • In addition to the general requirements listed in the Private Cloud Installation Requirements documentation, CDW also has the following minimum memory, storage, and hardware requirements for each OpenShift worker node:
    Component Minimum Recommended
    CPU 16 cores (can be achieved with 8 cores that have Hyper-Threading enabled) 32+ cores (can also be achieved by enabling Hyper-Threading)
    Memory 128 GB 384 GB
    Storage (locally attached storage per Virtual Warehouse executor by using OpenShift Local Storage Operator) 600 GB per executor (SATA) 600 GB per executor (SSD/NVMe)
    Storage (persistent volume storage on the file system mounts per Virtual Warehouse) Approx. 100 GB (5 x 20 GB) Approx. 100 GB (5 x 20 GB)
    Network Bandwidth 1 GB/s guaranteed bandwidth to every CDP Private Cloud Base node 10 GB/s guaranteed bandwidth to every CDP Private Cloud Base node

Depending on the number of executors you want to run on each physical node, the per-node requirements change proportionally. For example, if you are running 3 executor pods per physical node, you require 384 GB of memory and approximately 1.8 TB of locally attached SSD/NVMe storage.

Security requirements

The CDW service requires the "cluster-admin" role on the OpenShift cluster in order to install correctly. The "cluster-admin" role enables namespace creation and the use of the OpenShift Local Storage Operator for local storage.