HBase Migration through Replication Manager

Apache HBase is a scalable, distributed, column-oriented datastore that provides real-time read/write random access to very large datasets hosted on HDFS. In CDP Operational Database or COD you use Apache HBase as a datastore with HDFS and/or S3/ABFS providing the storage infrastructure.

You can use one of the following methods to replicate HBase data based on your requirements:

Table 1. Replication methods
Methods Description When to use
Cloudera Replication Plugin for cluster versions that Replication Manager does not support. You can prepare your data for migration, then set up the replication plugin and use a snapshot to migrate your data. The following list consolidates all the minimum supported versions of source and target cluster combinations for which you can use the replication plugin to replicate HBase data. The replication plugin is compatible with all the CDP Public Cloud releases.
  • From CDH 5.10 using CM 6.3.0 to CDP Public Cloud on AWS.
  • From CDH 5.10 using CM 6.3.4 to CDP Public Cloud on Azure.
  • From CDH 6.1 using CM 6.3.0 to CDP Public Cloud on AWS.
  • From CDH 6.1 using CM 7.1.1/6.3.4 to CDP Public Cloud on Azure.
  • CDP 7.1.1 using CM 7.1.1 to CDP Public Cloud on AWS and Azure.
  • HDP 2.6.5 and HDP 3.1.1 to CDP Public Cloud on AWS and Azure.

For information about use cases that are not supported by Replication Manager, see support matrix.

Replication Manager You can use Replication Manager to migrate HBase data that uses HBase replication or you can create a HBase replication policy When the source cluster and target cluster meet the requirements of supported use cases. See caveats.

The following list consolidates all the minimum supported versions of source and target cluster combinations for which you can use HBase replication policies to replicate HBase data.

  • From CDP 7.1.6 using CM 7.3.1 to CDP 7.2.14 Data Hub using CM 7.6.0.
  • From CDH 6.3.3 using CM 7.3.1 to CDP 7.2.14 Data Hub using CM 7.6.0.
  • From CDH 5.16.2 using CM 7.4.4 (patch-5017) to COD 7.2.14.
  • From COD 7.2.14 to COD 7.2.14.

See support matrix for more information.