Set properties in Cloudera Manager
When you are satisfied with the cluster configuration estimates, use the values in the spreadsheet to set the corresponding properties in Cloudera Manager
Step | YARN/MapReduce Property | Cloudera Manager Equivalent |
---|---|---|
4 |
yarn.nodemanager.resource.cpu-vcores
|
Container Virtual CPU Cores |
4 |
yarn.nodemanager.resource.memory-mb
|
Container Memory |
6 |
yarn.scheduler.minimum-allocation-vcores
|
Container Virtual CPU Cores Minimum |
6 |
yarn.scheduler.maximum-allocation-vcores
|
Container Virtual CPU Cores Maximum |
6 |
yarn.scheduler.increment-allocation-vcores
|
Container Virtual CPU Cores Increment |
6 |
yarn.scheduler.minimum-allocation-mb
|
Container Memory Minimum |
6 |
yarn.scheduler.maximum-allocation-mb
|
Container Memory Maximum |
6 |
yarn.scheduler.increment-allocation-mb
|
Container Memory Increment |
7 |
yarn.app.mapreduce.am.resource.cpu-vcores
|
ApplicationMaster Virtual CPU Cores |
7 |
yarn.app.mapreduce.am.resource.mb
|
ApplicationMaster Memory |
7 |
mapreduce.map.cpu.vcores
|
Map Task CPU Virtual Cores |
7 |
mapreduce.map.memory.mb
|
Map Task Memory |
7 |
mapreduce.reduce.cpu.vcores
|
Reduce Task CPU Virtual Cores |
7 |
mapreduce.reduce.memory.mb
|
Reduce Task Memory |
7 |
mapreduce.task.io.sort.mb
|
I/O Sort Memory |