Ephemeral Storage

COD now supports NVMe (Non-volatile Memory Express) based cache that significantly improves the performance when you deploy COD with object storage.

Accessing cloud storage is generally slower than block storage, as data in such deployments is not local to HBase. Our benchmarks show that COD over cloud storage performs, on average, five times slower than COD clusters using HDFS on block storage with HDD. To address this penalty, COD uses ephemeral storage (NVMe disks available with all major cloud providers) to deploy RegionServers with file base bucket cache on the ephemeral volumes. With all data cached locally in the ephemeral disks, COD on cloud storage can achieve performance parity compared to COD with HDFS on block storage, but at a lower cost.

Once you enable the entitlement for your tenant, COD automatically configures the newly created cluster for this feature. It also allows the auto-scale functionality based on the available cache space. For more information, see Auto-scaling in public cloud environments. No additional configuration is needed.

AWS

COD supports a 1.6 TB NVMe based cache that significantly improves the performance when you deploy COD with S3.

Azure

The NVMe-based cache is now enabled on Azure too. It uses a high-performance AMD instance type with a 2 TB NVMe disk for the worker nodes.

GCP

COD supports a 3 TB NVMe-based cache that uses local SSD for ephemeral storage on GCP. This significantly enhances the performance when you deploy COD on GCP.