Cloudera Data Warehouse hardware requirements
Review the requirements needed to get started with the Cloudera Data Warehouse (CDW) service on Red Hat OpenShift 4.5 clusters.
- CDP Cloudera Manager must be installed and running.
- CDP Private Cloud must be installed and running. See Private Cloud Installation Requirements for more details.
- An environment must have been registered with Management Console on the private cloud. See CDP Private Cloud Environments for more details.
- In addition to the general requirements listed in the Private Cloud Installation Requirements
documentation, CDW also has the following minimum memory, storage, and
hardware requirements for each OpenShift worker node:
Component Minimum Recommended CPU 16 cores (can be achieved with 8 cores that have Hyper-Threading enabled) 32+ cores (can also be achieved by enabling Hyper-Threading) Memory 128 GB 384 GB Storage (locally attached storage per Virtual Warehouse executor by using OpenShift Local Storage Operator) 600 GB per executor (SATA) 600 GB per executor (SSD/NVMe) Storage (persistent volume storage on the file system mounts per Virtual Warehouse) Approx. 100 GB (5 x 20 GB) Approx. 100 GB (5 x 20 GB) Network Bandwidth 1 GB/s guaranteed bandwidth to every CDP Private Cloud Base node 10 GB/s guaranteed bandwidth to every CDP Private Cloud Base node
Depending on the number of executors you want to run on each physical node, the per-node requirements change proportionally. For example, if you are running 3 executor pods per physical node, you require 384 GB of memory and approximately 1.8 TB of locally attached SSD/NVMe storage.
The CDW service requires the "cluster-admin" role on the OpenShift cluster in order to install correctly. The "cluster-admin" role enables namespace creation and the use of the OpenShift Local Storage Operator for local storage.