ADLS Gen2 account for storing operating system images

CDP uses an ADLS Gen2 storage account for storing operating system images used for VMs. By default, CDP creates this account during environment registration, but you can optionally pre-create it. If needed, you can also copy the VHD files and create image resources manually.

CDP uses an ADLS Gen2 for storing operating system images used for VMs. These images are used for:

  • Data Lake and Data Hub clusters (A single image is used for both)
  • FreeIPA (A separate image is used)

For each of these, there is one image for each Runtime version and for each Azure region.

Preparing images for VMs on Azure is a three-step process, involving the following steps:

  1. Creating a new storage account in your subscription. The storage account is reachable from all networks so that CDP can access it (although the storage container is private).
  2. Copying one or more virtual hard disks (VHDs) from Cloudera’s regional storage account to your storage account created earlier.
  3. Creating an image resource from each copied VHD.

By default, these steps are performed automatically by CDP during the “Setting up CDP image” and the “Creating infrastructure” steps of launching a stack. However, if due to your organization’s security policies, you do not want CDP to create your storage account or you do not want the storage account to be publicly available, you have two alternatives:

Scenario Solution Steps
You do not want CDP to create a storage account in your Azure subscription or CDP is not granted the permission to create new storage accounts in your Azure subscription, but you are willing to provide CDP access to the storage account once it exists. Manually pre-create a storage account that is available from all networks, and once it exists, CDP can copy VHD files and create the image resources. Refer to Creating the storage account for images manually.
Image copying by CDP is not possible because the storage account should not be publicly available. You should perform all three steps manually. See all three sub-steps linked in this section.

If you would like to perform these manual steps, refer to the following instructions: