Feature Comparison Matrix for Replication Manager on Private Cloud Base

Replication Manager supports replication of data in HDFS and Hive.

The Feature Compatibility Matrix table lists the compatibility information across features of Replication Manager which includes the supported CDH, CDP Private Cloud Base, and Cloudera Manager versions.
Table 1. Feature Compatibility Matrix
Feature Lowest supported Cloudera Manager Version Lowest supported CDH Version Supported Services
Replication Cloudera Manager 5.14+ CDH 5.13+ HDFS, Hive, Impala
Replication to and from Amazon S3* Cloudera Manager 5.14+ CDH 5.13+ HDFS, Hive, Impala
Snapshots Cloudera Manager 5.15+ CDH 5.15+ HDFS, Hive, Impala
Replication to and from Microsoft ADLS Gen1 Cloudera Manager 5.15, 5.16, 6.1+ CDH 5.13+ HDFS, Hive, Impala
Replication to Microsoft ADLS Gen2 (ABFS) Cloudera Manager 6.1+ CDH 5.13+ HDFS, Hive, Impala
*Replication Manager does not support S3 as a source or destination when S3 is configured to use SSE-KMS.

Starting in Cloudera Manager 6.1.0, Replication Manager ignores Hive tables backed by Kudu during replication. The change does not affect functionality since Replication Manager does not support tables backed by Kudu. This change was made to guard against data loss due to how the Hive Mestastore, Impala, and Kudu interact.

Supported Replication Scenarios

To replicate data to or from clusters managed by Cloudera Manager 7.x, the source or destination cluster must be managed by Cloudera Manager 5.14+ or higher. Note that some functionality may not be available in Cloudera Manager 5.14.0 and higher or 6.0.0 and higher.
Replication Manager supports the following replication scenarios when Kerberos authentication is used on a cluster:
  • Secure source to a secure destination.
  • Insecure source to an insecure destination.
  • Insecure source to a secure destination. The following requirements must be met for this scenario:
    • When a destination cluster has multiple source clusters, all the source clusters must either be secure or insecure. Replication Manager does not support a mix of secure and insecure source clusters.
    • The destination cluster must run Cloudera Manager 7.x or higher.
    • The source cluster must run a compatible Cloudera Manager version.
    • This replication scenario requires additional configuration. For more information, see Replicating from Unsecure to Secure Clusters.
Cloud Storage
Replication Manager supports replicating to or from Amazon S3, Microsoft Azure ADLS Gen1, and Microsoft Azure ADLS Gen2 (ABFS).
Transport Layer Security (TLS)
You can use TLS with Replication Manager. Additionally, Replication Manager supports replication scenarios where TLS is enabled for non-Hadoop services (Hive/Impala) and TLS is disabled Hadoop services (such as HDFS,YARN, and MapReduce).

Unsupported Replication Scenarios

Replicating data from CDP Private Cloud Base clusters is not supported.
Replicating to or from Cloudera Manager 6 managed clusters with Cloudera Manager versions earlier than 5.14.0 are not supported.
Hive Replication
Replication Manager does not support Managed to Managed table replication. It translates the Managed table from the source clusters to the CDP Private Cloud Base cluster as an External table. Replication Manager stores the replicated table as an External table.
When Kerberos authentication is used on a cluster, replication from a secure source to an insecure destination is not supported.
Ranger to Ranger replication is not supported.