Configured SDX Namespace Use Cases

The configured SDX namespace enables you to share your Hive metastore and Sentry policies among clusters that you launch in the cloud. For example, if you set up a Hive metastore and Sentry database for clusters that you create using Altus Director, you can use the same Hive metastore and Sentry databases for clusters that you create with Altus services.

A common use case for configured SDX namespaces is when you need additional capacity for a workload. Typically, you maintain a large cluster with capacity to handle any spike in workload volume. For example, you have a workload that runs every day. Most days of the month you might use only 50% of capacity to run the workload. But at the end of the month, the volume of data you need to process is higher and you need much more capacity to be able to meet workload SLAs.

An Altus SDX namespace enables you to use Altus clusters to meet the capacity requirements at the end of the month without having to maintain the maximum capacity throughout the month. When your cluster requirements go up at the end of the month, you can use Altus clusters to increase your capacity to run your workload. You can create Altus clusters and set them up to use a configured SDX namespace that point to the Hive metastore and Sentry databases used by the other clusters in the workload. The Altus cluster can immediately access the dataset using the metadata in the SDX namespace without the need to first define the metadata for the dataset accessed by the workload.

After the monthly spike, when you no longer need the extra capacity, you can delete the Altus cluster and run the workload with the cluster capacity that you regularly need.