Cloudera Docs

Register Azure cloud credentials in Replication Manager

You require an ADLS Gen2 storage account that has a cloud Blob container with user credentials to use in the Replication Manager service. The container must have enough space for the replicated data, and write permissions to copy the data.

Currently, registering Azure cloud credentials using the Replication Manager UI does not automatically create the same authorisation rules on the source Cloudera Manager cluster. When you plan to submit the replication policies with Azure as your cloud storage, Cloudera recommends that you update the cloud credentials in the source Cloudera Manager.

Registering ABFS cloud account in Replication Manager

You must have valid ABFS credentials in Cloudera Replication Manager to register the cloud account.

Consider the following requirements before you register an ABFS cloud account in Replication Manager:
  • You require an ADLS Gen2 storage account that has a cloud Blob container with user credentials to use in the Replication Manager service.
  • The container must have enough space for the replicated data, and write permissions to copy the data.
  • The container must support cloud storage encryption types supported by Replication Manager (SSE-S3 & SSE-KMS).
  1. Click Cloudera Replication Manager > Cloud Credentials > Add.
  2. Perform the following steps on the Add Cloud Credential modal window:
    1. Select the Cluster.
    2. Select ABFS as the Cloud Storage Type.
    3. Enter the cloud credential Name.
    4. Enter your ABFS Storage Client Id.
    5. Enter your ABFS Storage Client Secret Key.
    6. Enter your ABFS Storage Tenant Id.
  3. Click Validate.
After you add the ABFS cloud credentials and you create a replication policy with ABFS as your selected cloud storage for your target cluster, the following error message might appear:

To resolve this issue, update the ABFS cloud credential values in the source Cloudera Manager instance. For more information, see Updating Azure Cloud Credentials in Cloudera Manager.

Verify whether the credentials appear on the Cloud Credentials page.

Updating Azure Cloud Credentials in Cloudera Manager

Before you register an ABFS cloud account in Replication Manager, Cloudera recommends that you update the cloud credentials in the source cluster Cloudera Manager. This is because registering Azure cloud credentials using the Replication Manager UI does not automatically create the same authorisation rules on the source Cloudera Manager cluster.

  1. Click Add AD Service Principal on the Cloudera Manager > Administration > Azure Credentials page for the source cluster instance.
  2. Enter the following details on the Add AD Service Principal modal window:
    1. Name of the credential.
    2. Client ID for the credential.
    3. Client Secret Key for the credential.
    4. Tenant ID for the credential.
  3. Click Add.
    The Azure Cloud credentials are successfully registered with the Cloudera Manager instance.
Register the ABFS cloud account in Cloudera Replication Manager.