Tez execution engine properties
If the performance of low-latency analytical processing (LLAP) degrades, you can adjust Tez properties to tune Hive LLAP performance, but generally changing Tez properties is not necessary.
Tuning Tez
In Ambari, select
to change general or advanced properties using guidelines in the following table. You can search for a property by entering it in the Filter field.Property | Guideline | Default |
---|---|---|
tez.am.resource.memory.mb |
4 GB maximum for most sites. Generally, do not change the value of this property unless you change resources on the cluster. | Depends on your environment |
tez.session.am.dag.submit.timeout.secs
|
300 minimum |
300 |
tez.am.container.idle.release-timeout-min.millis
|
20000 minimum |
10000 |
tez.am.container.idle.release-timeout-max.millis
|
40000 minimum |
20000 |
tez.shuffle-vertex-manager.desired-task-input-size |
Increase for large ETL jobs that run too long. | No default value set |
tez.min.partition.factor |
Increase for more reducers. Decrease for fewer reducers. | 0.25 |
tez.max.partition.factor |
Increase for more reducers. Decrease for fewer reducers. | 2.0 |
tez.shuffle-vertex-manager.min-task-parallelism |
Set a value if reducer counts are too low, even if the
tez.shuffle-vertex-manager.min-src-fraction property is already
adjusted. |
No default value set |
tez.shuffle-vertex-manager.min-src-fraction |
Increase to start reducers later. Decrease to start reducers sooner. | 0.2 |
tez.shuffle-vertex-manager.max-src-fraction |
Increase to start reducers later. Decrease to start reducers sooner. | 0.4 |
hive.vectorized.execution.enabled
|
true |
0.4 |
hive.mapjoin.hybridgrace.hashtable
|
true for slower but safer processing. false for
faster processing. |
false |