loading table of contents...

2.3.  Cluster Configuration: Custom

These properties are required if using Custom configuration.

Required Properties

Description

Example Value

WebHDFS FileSystem URI

The WebHDFS FileSystem URI in the format webhdfs://<HOST>:<HTTP_PORT>

webhdfs://namenode:50070

These properties are required if your cluster is configured for NameNode HA.

Property

Description

Example Value

Logical name of the NameNode cluster

Comma-separated list of nameservices.

hdfs-site/dfs.nameservices

For example:

nameservice

List of NameNodes

Comma-separated list of NameNodes for a given nameservice.

hdfs-site/dfs.ha.namenodes

For example:

namenode1,namenode2

First NameNode RPC Address

RPC address for first name node.

hdfs-site/dfs.namenode.rpc-address.[nameservice].[namenode1]

Second NameNode RPC Address

RPC address for second NameNode.

hdfs-site/dfs.namenode.rpc-address.[nameservice].[namenode2]

First NameNode HTTP (WebHDFS) Address

WebHDFS address for first NameNode.

hdfs-site/dfs.namenode.http-address.[nameservice].[namenode1]

Second NameNode HTTP (WebHDFS) Address

WebHDFS address for second NameNode.

hdfs-site/dfs.namenode.http-address.[nameservice].[namenode2]

Failover Proxy Provider

The Java class that HDFS clients use to contact the Active NameNode.

hdfs-site/dfs.client.failover.proxy.provider.[nameservice]