Chapter 2. Configuring Ports

The tables below specify which ports must be opened for which ecosystem components to communicate with each other. Make sure the appropriate ports are opened before you install HDP.

HDFS Ports: The following table lists the default ports used by the various HDFS services.

Table 2.1. HDFS Ports
Service Servers Default Ports Used Protocol Description Need End User Access? Configuration Parameters

NameNode WebUI

Master Nodes (NameNode and any back-up NameNodes) 50070 http Web UI to look at current status of HDFS, explore file system Yes (Typically admins, Dev/Support teams) dfs.http.address
50470 https Secure http service dfs.https.address

NameNode metadata service

8020/9000 IPC

File system metadata operations

Yes (All clients who directly need to interact with the HDFS) Embedded in URI specified by fs.default.name

DataNode

All Slave Nodes

50075

http

DataNode WebUI to access the status, logs etc.

Yes (Typically admins, Dev/Support teams) dfs.datanode.http.address

50475

https

Secure http service

dfs.datanode.https.address

50010

Data transfer

dfs.datanode.address

50020

IPC

Metadata operations

No dfs.datanode.ipc.address
Secondary NameNode Secondary NameNode and any backup Secondanry NameNode

50090

http

Checkpoint for NameNode metadata

No dfs.secondary.http.address

YARN Ports: The following table lists the default ports used by the various YARN services.

Table 2.2. YARN Ports
Service Servers Default Ports Used Protocol Description Need End User Access? Configuration Parameters

Resource Manager WebUI

Master Nodes (Resource Manager and any back-up Resource Manager node) 8088 http Web UI for Resource Manager Yes yarn.resourcemanager.webapp.address

Resource Manager

Master Nodes (Resource Manager Node) 8032 IPC

For application submissions

Yes (All clients who need to submit the YARN applications including Hive, Hive server, Pig) Embedded in URI specified by yarn.resourcemanager.address

NodeManager Web UI

All Slave Nodes

50060

http Yes (Typically admins, Dev/Support teams) yarn.nodemanager.webapp.address

Hive Ports: The following table lists the default ports used by the various Hive services.

[Note]Note

Neither of these services are used in a standard HDP installation.

Table 2.3. Hive Ports
Service Servers Default Ports Used Protocol Description Need End User Access? Configuration Parameters

Hive Server

Hive Server machine (Usually a utility machine) 10000 Service for programatically (Thrift/JDBC) connecting to Hive Yes (Clients who need to connect to Hive either programatically or through UI SQL tools that use JDBC) ENV Variable HIVE_PORT

Hive Web UI

Hive Server machine (Usually a utility machine) 9999 http

Web UI to explore Hive schemas

Yes hive.hwi.listen.port

Hive Metastore

9933 http Yes (Clients that run Hive, Pig and potentially M/R jobs that use HCatalog) hive.metastore.uris

HBase Ports: The following table lists the default ports used by the various HBase services.

Table 2.4. HBase Ports
Service Servers Default Ports Used Protocol Description Need End User Access? Configuration Parameters

HMaster

Master Nodes (HBase Master Node and any back-up HBase Master node) 60000 Yes hbase.master.port

HMaster Info Web UI

Master Nodes (HBase master Node and back up HBase Master node if any) 60010 http The port for the HBase­Master web UI. Set to -1 if you do not want the info server to run. Yes hbase.master.info.port

Region Server

All Slave Nodes 60020 Yes (Typically admins, dev/support teams) hbase.regionserver.port

Region Server

All Slave Nodes 60030 http Yes (Typically admins, dev/support teams) hbase.regionserver.info.port
HBase REST Server (optional) All REST Servers 8080 http The port used by HBase Rest Servers. REST servers are optional, and not installed by default Yes hbase.rest.port
HBase REST Server Web UI (optional) All REST Servers 8085 http The port used by HBase Rest Servers web UI. REST servers are optional, and not installed by default Yes (Typically admins, dev/support teams) hbase.rest.info.port
HBase Thrift Server (optional) All Thrift Servers 9090 The port used by HBase Thrift Servers. Thrift servers are optional, and not installed by default Yes
HBase Thrift Server Web UI (optional) All Thrift Servers 9095 The port used by HBase Thrift Servers web UI. Thrift servers are optional, and not installed by default Yes (Typically admins, dev/support teams) hbase.thrift.info.port

ZooKeeper Ports

Table 2.5. ZooKeeper Ports
Service Servers Default Ports Used Protocol Description Need End User Access? Configuration Parameters
ZooKeeper Server All ZooKeeper Nodes 2888 Port used by ZooKeeper peers to talk to each other. See here for more information. No hbase.zookeeper.peerport
ZooKeeper Server All ZooKeeper Nodes 3888 Port used by ZooKeeper peers to talk to each other.See here for more information. No hbase.zookeeper.leaderport
ZooKeeper Server All ZooKeeper Nodes 2181 Property from ZooKeeper's config zoo.cfg. The port at which the clients will connect. No hbase.zookeeper.property.clientPort

MySQL Ports: The following table lists the default ports used by the various MySQL services.

Table 2.6. MySQL Ports
Service Servers Default Ports Used Protocol Description Need End User Access? Configuration Parameters
MySQL MySQL database server 3306