Cloudera Docs

Verify cluster requirements

Before you create a replication policy on your on-premises cluster, you must verify whether the cluster requirements are met.

Cluster requirements to create a replication policy in the Replication Manager include:
  • Registering the CDH cluster on the Management Console. For more information, see Add a CDH cluster.
  • Registering the CDP Private Cloud Base cluster on the Management Console. For more information, see Adding a CDP Private Cloud Base cluster.
  • Verifying whether the source cluster and target cluster meet the requirements as specified in the Support Matrix.

  • Verifying whether the following requirements are met for HDFS replication:

    • Ensuring that the Replication Manager service interacts with the classic cluster-registered Cloudera Manager instance.
    • Ensuring that an external account is available in the Cloudera Manager instance that has access to the bucket or container where the HDFS data is being copied to. For more information, see Role-based credential on AWS, App-based credential on Azure, and Cloudera Manager documentation.

  • Verifying whether the Replication Manager service interacts with the Data Lake Cloudera Manager instance and vice-versa for Hive replication

    .

  • Verifying whether the following requirements are met for HBase replication:

    • The required Cloudera Operational Database (COD) cluster or Data Lake cluster is available.
    • The Replication Manager service interacts with the Data Lake cluster that runs the Cloudera Manager instance and vice-versa.
    • In addition to an external account in the Cloudera Manager instance, an IAM external account with hbase-replication as the username exists in the Data Lake cluster that has a Cloudera Manager instance.
    • The required ports are available and open during HBase replication.
    • If the source cluster is a CDH cluster, you can replicate data to a Data Lake or COD in the CDP Public Cloud Cluster after you install the required parcel in the source cluster.

      For information about the required parcel, contact Cloudera Support. For information about accessing the Parcels page, downloading, distributing, and activating the parcel, see Managing Parcels.

  • Verifying whether the managed identity of source roles, Storage Blob Data Owner or Storage Blob Data Contributor, are assigned to the destination storage data container and vice versa for bidirectional replication in Microsoft Azure.