Get started with OpenShift requirements

This topic lists memory, storage, and hardware requirements for getting started with the Cloudera Data Warehouse (CDW) service on Red Hat OpenShift.

To get started with the CDW service on Red Hat OpenShift, make sure you have fulfilled the following requirements:

  • CDP Cloudera Manager must be installed and running.
  • CDP Private Cloud must be installed and running. See Private Cloud Installation Requirements for more details.
  • An environment must have been registered with Management Console on the private cloud. See CDP Private Cloud Environments for more details.
  • In addition to the general requirements listed in the Private Cloud Installation Requirements documentation, CDW also has the following minimum memory, storage, and hardware requirements for each OpenShift worker node:
    Component Minimum Recommended
    CPU 16 cores (can be achieved with 8 cores that have Hyper-Threading enabled) 32+ cores (can also be achieved by enabling Hyper-Threading)
    Memory 128 GB 384 GB
    Storage (locally attached storage per Virtual Warehouse executor by using OpenShift Local Storage Operator) 600 GB per executor (SATA) 600 GB per executor (SSD/NVMe)
    Storage (persistent volume storage on the file system mounts per Virtual Warehouse) Approx. 100 GB (5 x 20 GB) Approx. 100 GB (5 x 20 GB)
    Network Bandwidth 1 GB/s guaranteed bandwidth to every CDP Private Cloud Base node 10 GB/s guaranteed bandwidth to every CDP Private Cloud Base node

Depending on the number of executors you want to run on each physical node, the per-node requirements change proportionally. For example, if you are running 3 executor pods per physical node, you require 384 GB of memory and approximately 1.8 TB of locally attached SSD/NVMe storage.