Cloudera Docs

Creating ADLS Gen2 storage account and containers

Create a resource group, a storage account, and two containers within it. The storage account must have hierarchical namespace enabled.

  1. Create a resource group that can act as a logical grouping of storage accounts.

    Follow the steps described in Create resource groups in the Azure documentation. Make sure to create it in the specific region that you want to use for your environment.

  2. Create an ADLS Gen2 storage account.

    In this example setup, the storage account name is my-datalake. To create the storage account, see Create an account using the Azure portal in the Azure documentation. Ensure that Enable hierarchical namespace is selected in the Data Lake Storage Gen2 section of the Advanced tab.

    Figure 1. Create a storage account
    Azure portal Create a storage account user interface indicating Security options in the Advanced tab
  3. Create one container within the ADLS Gen 2 storage account for Logs Location Base.
    Optinoally, you can create one container within the ADLS Gen 2 storage account for Logs Location Base.
    1. On the Azure Portal, go to Storage Accounts > your newly created storage account > Containers > +Container.
    2. Enter a name for your container.
    3. Click OK.
  4. Repeat these steps to create all required containers. In our example setup, the containers are called storagefs, logsfs, and backupfs.
Once you have created the storage account and container, note the created resources in the following format:
abfs://$[container-name]@$[storage-account-name].dfs.core.windows.net
For example, in our example setup, we created the following two containers:
abfs://logsfs@mydatalake.dfs.core.windows.net
abfs://backupfs@mydatalake.dfs.core.windows.net