Cloudera Docs

Ports for Replication Manager on CDP Public Cloud

Before you create replication policies, you must ensure that the required ports are open and available for data replication. You can verify the mandatory ports using the Replication Manager network security diagram.

HDFS replication polices

The following ports must be open and available for Replication Manager for HDFS replication policies:
Table 1. Minimum ports required for HDFS replication policies
Connectivity required Default Port Type Description
Data transfer from classic cluster hosts to cloud storage 80 or 443 (TLS) Outbound Outgoing port. All classic cluster nodes must be able to access S3/ADLS Gen2 endpoint.
Classic cluster 6000-6049 for CCMv1

443 for CCMv2

 Outbound Connecting source classic cluster to the CDP Management Console through Cluster Connectivity Manager (CCM).

For more information, see Outbound network access for CCM,and CCM overview.
The following system architecture diagram shows the interaction between components during HDFS replication using HDFS replication policies:
Figure 1. System architecture diagram for HDFS replication in CDP Public Cloud Replication Manager
The image shows the system architecture diagram for Replication Manager in CDP Public Cloud.

Hive replication polices

The following ports must be open and available for Replication Manager for Hive replication policies:
Table 2. Minimum ports required for Hive replication policies
Connectivity required for Default Port Type Description
Data transfer from classic cluster hosts to cloud storage 80 or 443 (TLS) Outbound Outgoing port. All classic cluster nodes must be able to access S3/ADLS Gen2 endpoint.
Cloudera Manager Admin Console HTTP 7180 or 7183 (when TLS enabled) Inbound Incoming port. Open on the source cluster to enable the target Cloudera Manager in cloud to communicate to the on-premises Cloudera Manager.
Classic cluster 6000-6049 for CCMv1

443 for CCMv2

 Outbound

Connecting the source classic cluster to the CDP Management Console through Cluster Connectivity Manager (CCM)

For more information, see Outbound network access for CCM,and CCM overview.
The following system architecture diagram shows the interaction between components during Hive replication using Hive replication policies:
Figure 2. System architecture diagram for Hive replication in CDP Public Cloud Replication Manager
The image shows the system architecture diagram for Replication Manager in CDP Public Cloud.

HBase replication policies

The following ports must be open and available for Replication Manager for HBase replication policies:

Table 3. Minimum ports required for HBase replication policies
Ports Service Description
2181 and 16020 Destination hosts of the AWS cluster or ADLS cluster (target cluster), and the Cloudera Manager server port on the source cluster Verify whether the ports 16020 for worker security group and 2181 for worker, master, and leader groups are open for connection from the source cluster to the destination cluster on AWS or Azure. This ensures that the source HBase service can communicate with Zookeeper and HBase services on the destination hosts uninterruptedly. For more information, see Ports for HBase replication.
16000 HMaster Open the port on the Master Nodes (HBase Master Node and any back-up HBase Master node).

Before you select the Validate Replication option during the first HBase replication policy creation between two specific clusters, you must ensure that the port is open on the target cluster.
7180 or 7183 Cloudera Manager Admin Console HTTP Open on the source cluster to enable Data lake Cloudera Manager to communicate to the on-premises Cloudera Manager. Connects to destination SDX Data Lake Cloudera Manager.
9000 Cloudera Manager Agent Open on the source and target cluster to retrieve diagnostic and log information.
6000-6049 Cluster Connectivity Manager (CCM) Required for SSL connections to the Control Plane via CCM to communicate with Replication Manager.
80 or 443 Data transfer from secondary node for AWS / ADLS Gen2 Outgoing port. Open on all the HDFS nodes for AWS and ADLS Gen2.
8443 Data Lake cluster Outgoing port. Configure the port on the Data Lake cluster as the outgoing port for CDP Management Console to communicate with Cloudera Manager and Knox.
8032 YARN Resource Manager Open on the source and target cluster to access the YARN ResourceManager.