|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.hadoop.hive.ql.exec.Task<MapredWork> org.apache.hadoop.hive.ql.exec.mr.ExecDriver
public class ExecDriver
ExecDriver is the central class in co-ordinating execution of any map-reduce task. It's main responsibilities are: - Converting the plan (MapredWork) into a MR Job (JobConf) - Submitting a MR job to the cluster via JobClient and ExecHelper - Executing MR job in local execution mode (where applicable)
Nested Class Summary |
---|
Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Task |
---|
Task.FeedType |
Field Summary | |
---|---|
static MemoryMXBean |
memoryMXBean
|
Fields inherited from class org.apache.hadoop.hive.ql.exec.Task |
---|
BACKUP_COMMON_JOIN, COMMON_JOIN, CONVERTED_MAPJOIN, CONVERTED_MAPJOIN_LOCAL, CONVERTED_SORTMERGEJOIN, HINTED_MAPJOIN, HINTED_MAPJOIN_LOCAL, MAPJOIN_ONLY_NOBACKUP, NO_TAG, taskCounters, taskHandle |
Constructor Summary | |
---|---|
ExecDriver()
Constructor when invoked from QL. |
|
ExecDriver(MapredWork plan,
org.apache.hadoop.mapred.JobConf job,
boolean isSilent)
Constructor/Initialization for invocation as independent utility. |
Method Summary | |
---|---|
boolean |
checkFatalErrors(org.apache.hadoop.mapred.Counters ctrs,
StringBuilder errMsg)
Fatal errors are those errors that cannot be recovered by retries. |
int |
execute(DriverContext driverContext)
Execute a query plan using Hadoop. |
static String |
generateCmdLine(HiveConf hconf,
Context ctx)
Given a Hive Configuration object - generate a command line fragment for passing such configuration information to ExecDriver. |
static String |
getCurrentDB()
|
String |
getName()
Gets the name of the node. |
Collection<Operator<? extends OperatorDesc>> |
getTopOperators()
|
org.apache.hadoop.hive.ql.plan.api.StageType |
getType()
Should be overridden to return the type of the specific task among the types in StageType. |
boolean |
hasReduce()
|
void |
initialize(HiveConf conf,
QueryPlan queryPlan,
DriverContext driverContext)
Initialization when invoked from QL. |
boolean |
isMapRedTask()
|
void |
logPlanProgress(SessionState ss)
|
static void |
main(String[] args)
|
boolean |
mapDone()
|
boolean |
mapStarted()
|
boolean |
reduceDone()
|
boolean |
reduceStarted()
|
boolean |
requireLock()
|
void |
shutdown()
|
Methods inherited from class org.apache.hadoop.hive.ql.exec.Task |
---|
addDependentTask, done, equals, executeTask, getAndInitBackupTask, getBackupChildrenTasks, getBackupTask, getChildren, getChildTasks, getCounters, getDependentTasks, getDriverContext, getFeedSubscribers, getId, getInitialized, getJobID, getParentTasks, getQueryPlan, getQueued, getReducer, getResultSchema, getTaskHandle, getTaskTag, getWork, hashCode, ifRetryCmdWhenFail, isLocalMode, isMapRedLocalTask, isRootTask, isRunnable, removeDependentTask, removeFromChildrenTasks, setBackupChildrenTasks, setBackupTask, setChildTasks, setConsole, setDone, setFeedSubscribers, setId, setInitialized, setLocalMode, setParentTasks, setQueryPlan, setQueued, setRetryCmdWhenFail, setRootTask, setStarted, setTaskTag, setWork, started, subscribeFeed, toString |
Methods inherited from class java.lang.Object |
---|
getClass, notify, notifyAll, wait, wait, wait |
Field Detail |
---|
public static MemoryMXBean memoryMXBean
Constructor Detail |
---|
public ExecDriver()
public ExecDriver(MapredWork plan, org.apache.hadoop.mapred.JobConf job, boolean isSilent) throws HiveException
HiveException
Method Detail |
---|
public boolean requireLock()
requireLock
in class Task<MapredWork>
public void initialize(HiveConf conf, QueryPlan queryPlan, DriverContext driverContext)
initialize
in class Task<MapredWork>
public boolean checkFatalErrors(org.apache.hadoop.mapred.Counters ctrs, StringBuilder errMsg)
checkFatalErrors
in interface HadoopJobExecHook
public int execute(DriverContext driverContext)
public static String getCurrentDB()
public boolean mapStarted()
public boolean reduceStarted()
public boolean mapDone()
public boolean reduceDone()
public static void main(String[] args) throws IOException, HiveException
IOException
HiveException
public static String generateCmdLine(HiveConf hconf, Context ctx) throws IOException
IOException
public boolean isMapRedTask()
isMapRedTask
in class Task<MapredWork>
public Collection<Operator<? extends OperatorDesc>> getTopOperators()
getTopOperators
in class Task<MapredWork>
public boolean hasReduce()
hasReduce
in class Task<MapredWork>
public org.apache.hadoop.hive.ql.plan.api.StageType getType()
Task
getType
in class Task<MapredWork>
public String getName()
Node
getName
in interface Node
public void logPlanProgress(SessionState ss) throws IOException
logPlanProgress
in interface HadoopJobExecHook
IOException
public void shutdown()
shutdown
in class Task<MapredWork>
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |