First-time setup configuration steps for HBase replication policy

Before you create an HBase replication policy between two clusters, you must change certain configuration settings on those clusters. Repeat these steps if you want to use another source cluster or target cluster for replication or the hbase-replication user password has changed.

Perform the following steps on the source cluster and the target cluster:

  1. On the Amazon S3 cluster and Microsoft ADLS Gen2 (ABFS) cluster, make sure that the ports 16020 for worker security group and 2181 for worker, master, and leader groups are available for replication.
  2. On the source cluster, create the /user/base folder for the hbase user in HDFS. To create the folder, run the following commands:
    sudo -u hdfs hdfs dfs -mkdir /user/hbase
    sudo -u hdfs hdfs dfs -chown hbase:hbase /user/hbase
    

    These commands allow the HBase replication policy to replicate the existing data in the source cluster.

  3. If the source cluster is COD that exists in a different environment than the target cluster, you must map the source cluster's gateway node in the /etc/hosts file of the destination cluster's gateway node. This is because during replication if the destination gateway host cannot resolve the IP address of the source gateway, it uses the mapping information in the /etc/hosts file of the destination cluster's gateway node.

    The following snippet shows the contents in a /etc/hosts file:
    10.121.141.49 cod--drruz410l-gateway0.dx-ar.2-8yd.devv.hcldr.erk
  4. On the target cluster, perform the following steps:
    1. On the Management Console page, perform the following steps:
      1. Click User Management.

      2. Verify whether the machine user hbase-replication exists. If not, click Actions > Create machine user to create the user.

      3. The hbase-replication user appears on the User Management page.

      4. Click the hbase-replication user. The user page is displayed.

      5. Click Set Workload Password to set the workload password for the user.

    2. Create a workload username srv_hbase-replication in the environment that you use.

    3. On the Environment page, perform the following steps:

      1. Open your environment, and click Summary.

      2. Click Actions > Manage Access.

      3. On the Access page, search for the hbase-replication user. Click Update Roles.

      4. In the Update Resource Roles for hbase-replication dialog box, select EnvironmentUser and click Update Roles.

      5. Click Actions > Synchronize Users to FreeIPA. In the Synchronize Users page, click Synchronize Users.

    4. In the HBase shell, run the kinit srv_hbase-replication command to verify that the credentials are available in the target cluster.

  5. Restart both the clusters.