org.apache.hadoop.hive.ql.exec.errors
Class MapAggrMemErrorHeuristic
java.lang.Object
org.apache.hadoop.hive.ql.exec.errors.RegexErrorHeuristic
org.apache.hadoop.hive.ql.exec.errors.MapAggrMemErrorHeuristic
- All Implemented Interfaces:
- ErrorHeuristic
public class MapAggrMemErrorHeuristic
- extends RegexErrorHeuristic
Detects out-of-memory errors when hash tables in map-based aggregation group
by queries take up too much memory.
Conditions to check
1. The query contains a group by.
2. Map-side aggregation is turned on.
3. There is a out of memory exception in the log.
Method Summary |
ErrorAndSolution |
getErrorAndSolution()
Examine the hive query, job configuration, and the lines from the task log
seen so far though processLogLine() and generate a possible cause/solution. |
void |
init(String query,
org.apache.hadoop.mapred.JobConf conf)
Initialize this error heuristic. |
MapAggrMemErrorHeuristic
public MapAggrMemErrorHeuristic()
init
public void init(String query,
org.apache.hadoop.mapred.JobConf conf)
- Description copied from interface:
ErrorHeuristic
- Initialize this error heuristic. Must be called before any other methods
are called
- Specified by:
init
in interface ErrorHeuristic
- Overrides:
init
in class RegexErrorHeuristic
getErrorAndSolution
public ErrorAndSolution getErrorAndSolution()
- Description copied from interface:
ErrorHeuristic
- Examine the hive query, job configuration, and the lines from the task log
seen so far though processLogLine() and generate a possible cause/solution.
Once this method is called, the implementing class should be reset to the
state before any processLogLine() calls were made.
- Specified by:
getErrorAndSolution
in interface ErrorHeuristic
- Specified by:
getErrorAndSolution
in class RegexErrorHeuristic
- Returns:
- a matching error, or null if a suitable match wasn't found.
Copyright © 2014 The Apache Software Foundation. All rights reserved.