Recommended configurations for the balancer
Depending on whether you want the HDFS Balancer to run in the background or at maximum speed, you can configure the values of certain properties through safety valves.
Property | Values for Running the Balancer in the Background | Value for Running the Balancer at Maximum Speed |
---|---|---|
DataNode | ||
dfs.datanode.balance.bandwidthPerSec | 10 MB | 10 GB |
Balancer | ||
dfs.balancer.moverThreads | 1000 | 20000 |
dfs.balancer.max-size-to-move | 10 GB | 100 GB |
dfs.balancer.getBlocks.min-block-size | 10 MB | 100 MB |