Cluster Configuration: Custom
These properties are required if using Custom configuration.
Required Properties |
Description |
Example Value |
---|---|---|
WebHDFS FileSystem URI | The WebHDFS FileSystem URI in the format
webhdfs://<HOST>:<HTTP_PORT> |
webhdfs://namenode:50070 |
These properties are required if your cluster is configured for NameNode HA.
Property |
Description |
Example Value |
---|---|---|
Logical name of the NameNode cluster |
Comma-separated list of nameservices. |
hdfs-site/dfs.nameservices For example: nameservice |
List of NameNodes |
Comma-separated list of NameNodes for a given nameservice. |
hdfs-site/dfs.ha.namenodes For example: namenode1,namenode2 |
First NameNode RPC Address |
RPC address for first name node. |
hdfs-site/dfs.namenode.rpc-address.[nameservice].[namenode1] |
Second NameNode RPC Address |
RPC address for second NameNode. |
hdfs-site/dfs.namenode.rpc-address.[nameservice].[namenode2] |
First NameNode HTTP (WebHDFS) Address |
WebHDFS address for first NameNode. |
hdfs-site/dfs.namenode.http-address.[nameservice].[namenode1] |
Second NameNode HTTP (WebHDFS) Address |
WebHDFS address for second NameNode. |
hdfs-site/dfs.namenode.http-address.[nameservice].[namenode2] |
Failover Proxy Provider |
The Java class that HDFS clients use to contact the Active NameNode. |
hdfs-site/dfs.client.failover.proxy.provider.[nameservice] |