Cluster Configuration: Custom
These properties are required if using Custom configuration.
|
Required Properties | Description |
Example Value |
|---|---|---|
|
WebHDFS FileSystem URI | The WebHDFS FileSystem URI in the format
webhdfs://<HOST>:<HTTP_PORT> |
webhdfs://namenode:50070 |
These properties are required if your cluster is configured for NameNode HA.
|
Property | Description |
Example Value |
|---|---|---|
|
Logical name of the NameNode cluster | Comma-separated list of nameservices. |
hdfs-site/dfs.nameservices For example: nameservice |
|
List of NameNodes |
Comma-separated list of NameNodes for a given nameservice. |
hdfs-site/dfs.ha.namenodes For example: namenode1,namenode2 |
|
First NameNode RPC Address |
RPC address for first name node. |
hdfs-site/dfs.namenode.rpc-address.[nameservice].[namenode1] |
|
Second NameNode RPC Address |
RPC address for second NameNode. |
hdfs-site/dfs.namenode.rpc-address.[nameservice].[namenode2] |
|
First NameNode HTTP (WebHDFS) Address |
WebHDFS address for first NameNode. |
hdfs-site/dfs.namenode.http-address.[nameservice].[namenode1] |
|
Second NameNode HTTP (WebHDFS) Address |
WebHDFS address for second NameNode. |
hdfs-site/dfs.namenode.http-address.[nameservice].[namenode2] |
|
Failover Proxy Provider |
The Java class that HDFS clients use to contact the Active NameNode. |
hdfs-site/dfs.client.failover.proxy.provider.[nameservice] |