Optimization and planning properties
The Ambari wizard automatically tunes the optimization- and planner-related configuration properties of Hive, Tez, and YARN, and you rarely need to make changes. However, in the event you want to tune these properties, guidelines are available.
Property | Setting Guideline If Manual Configuration Is Needed | Default Value in Ambari |
---|---|---|
|
one-third of -Xmx value |
Auto-tuned: Depends on environment |
hive.tez.container.size |
Production Systems: 4 to 8 GB Small VMs: 1 to 2 GB |
Auto-tuned: Depends on environment |
hive.tez.java.opts |
-Xmx value must be 80% to 90% of container size |
Auto-tuned: Depends on environment |
tez.grouping.min.size |
Decrease for better latency Increase for more throughput |
16777216 |
tez.grouping.max.size |
Decrease for better latency Increase for more throughput |
1073741824 |
tez.grouping.split-waves |
Increase to launch more containers Decrease to enhance multitenancy |
1.7 |
yarn.scheduler.minimum-allocation-mb |
1 GB is usually sufficient | Auto-tuned: Depends on environment |