Support matrix for Replication Manager on CDP Private Cloud Base

The support matrix contains compatibility information across features in Replication Manager. Replication Manager supports HDFS and Hive data replication. The matrix also lists the supported versions for CDH, CDP Private Cloud Base, and Cloudera Manager versions.


Feature	Lowest supported Cloudera Manager Version	Lowest supported CDH Version	Supported Services
Replication	Cloudera Manager 5.14+	CDH 5.13+	HDFS, Hive, Impala
Replication to and from Amazon S3*	Cloudera Manager 5.14+	CDH 5.13+	HDFS, Hive, Impala
Snapshots	Cloudera Manager 5.15+	CDH 5.15+	HDFS, Hive, Impala
Replication to and from Microsoft ADLS Gen1	Cloudera Manager 5.15, 5.16, 6.1+	CDH 5.13+	HDFS, Hive, Impala
Replication to Microsoft ADLS Gen2 (ABFS)	Cloudera Manager 6.1+	CDH 5.13+	HDFS, Hive, Impala

*Replication Manager does not support S3 as a source or destination when S3 is configured to use SSE-KMS.

Starting in Cloudera Manager 6.1.0, Replication Manager ignores Hive tables backed by Kudu during replication. The change does not affect functionality since Replication Manager does not support tables backed by Kudu. This change was made to guard against data loss due to how the Hive Mestastore, Impala, and Kudu interact.

Supported replication scenarios

Kerberos

Replication Manager supports the following replication scenarios when Kerberos authentication is used on a cluster:

Secure source to a secure destination.
Insecure source to an insecure destination.
Insecure source to a secure destination. The following requirements must be met for this scenario:
- When a destination cluster has multiple source clusters, all the source clusters must either be secure or insecure. Replication Manager does not support a mix of secure and insecure source clusters.
- The destination cluster must run Cloudera Manager 7.x or higher.
- The source cluster must run a compatible Cloudera Manager version.
- This replication scenario requires additional configuration. For more information, see Replicating from Unsecure to Secure Clusters.

Cloud Storage

Replication Manager supports replicating to or from Amazon S3, Microsoft Azure ADLS Gen1, and Microsoft Azure ADLS Gen2 (ABFS).

Transport Layer Security (TLS)

You can use TLS with Replication Manager. Additionally, Replication Manager supports replication scenarios where TLS is enabled for non-Hadoop services (Hive/Impala) and TLS is disabled Hadoop services (such as HDFS,YARN, and MapReduce).

Sentry to Ranger replication

You require Cloudera Manager version 6.3.1 and above to run HDFS replication policies on a Sentry-enabled source cluster and to run Hive replication policies to migrate Sentry policies in source cluster to Ranger policies in target cluster.

When the source cluster is Sentry-enabled and you want to run HDFS replication policies, use the hdfs user to run the replication policy. The replication policy copies the permissions of replicated files and tables to the target cluster. To use any other user account, make sure that you configure the user account to bypass Sentry ACLs during replication.

You can use the Hive replication policies to migrate the Sentry policies to Ranger policies for Hive objects and URLs. The Sentry policies are automatically converted to Ranger policies in the target cluster.

Unsupported Replication Scenarios

Versions: Replicating to and from HDP to Cloudera Manager 7.x is not supported.
Kerberos: When Kerberos authentication is used on a cluster, replication from a secure source to an insecure destination is not supported.
Hive Replication: Hive replication policies do not support managed to managed table replication. When you replicate from a CDH cluster to a CDP Private Cloud Base cluster, Replication Manager converts managed tables to external tables.
Ranger: Ranger to Ranger replication is not supported.
Apache Knox: If Cloudera Manager is configured with Knox, Replication Manager does not work.