org.apache.hadoop.hive.ql.io.rcfile.stats
Class PartialScanTask
java.lang.Object
org.apache.hadoop.hive.ql.exec.Task<PartialScanWork>
org.apache.hadoop.hive.ql.io.rcfile.stats.PartialScanTask
- All Implemented Interfaces:
- Serializable, HadoopJobExecHook, Node
public class PartialScanTask
- extends Task<PartialScanWork>
- implements Serializable, HadoopJobExecHook
PartialScanTask.
This task handles RCFile statics calculation via partial scan.
Instead of reading all bytes, it reads block header and aggregates result.
https://issues.apache.org/jira/browse/HIVE-3958
- See Also:
- Serialized Form
Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Task |
Task.FeedType |
Fields inherited from class org.apache.hadoop.hive.ql.exec.Task |
BACKUP_COMMON_JOIN, COMMON_JOIN, CONVERTED_MAPJOIN, CONVERTED_MAPJOIN_LOCAL, CONVERTED_SORTMERGEJOIN, HINTED_MAPJOIN, HINTED_MAPJOIN_LOCAL, MAPJOIN_ONLY_NOBACKUP, NO_TAG, taskCounters, taskHandle |
Methods inherited from class org.apache.hadoop.hive.ql.exec.Task |
addDependentTask, done, equals, executeTask, getAndInitBackupTask, getBackupChildrenTasks, getBackupTask, getChildren, getChildTasks, getCounters, getDependentTasks, getDriverContext, getFeedSubscribers, getId, getInitialized, getJobID, getParentTasks, getQueryPlan, getQueued, getReducer, getResultSchema, getTaskHandle, getTaskTag, getTopOperators, getWork, hashCode, hasReduce, ifRetryCmdWhenFail, isLocalMode, isMapRedLocalTask, isMapRedTask, isRootTask, isRunnable, removeDependentTask, removeFromChildrenTasks, setBackupChildrenTasks, setBackupTask, setChildTasks, setConsole, setDone, setFeedSubscribers, setId, setInitialized, setLocalMode, setParentTasks, setQueryPlan, setQueued, setRetryCmdWhenFail, setRootTask, setStarted, setTaskTag, setWork, shutdown, started, subscribeFeed, toString |
INPUT_SEPERATOR
public static String INPUT_SEPERATOR
PartialScanTask
public PartialScanTask()
initialize
public void initialize(HiveConf conf,
QueryPlan queryPlan,
DriverContext driverContext)
- Overrides:
initialize
in class Task<PartialScanWork>
requireLock
public boolean requireLock()
- Overrides:
requireLock
in class Task<PartialScanWork>
execute
public int execute(DriverContext driverContext)
- Description copied from class:
Task
- This method is overridden in each Task. TODO execute should return a TaskHandle.
- Returns:
- status of executing the task
getName
public String getName()
- Description copied from interface:
Node
- Gets the name of the node. This is used in the rule dispatchers.
- Specified by:
getName
in interface Node
- Returns:
- String
main
public static void main(String[] args)
getType
public org.apache.hadoop.hive.ql.plan.api.StageType getType()
- Description copied from class:
Task
- Should be overridden to return the type of the specific task among the types in StageType.
- Specified by:
getType
in class Task<PartialScanWork>
- Returns:
- StageType.* or null if not overridden
checkFatalErrors
public boolean checkFatalErrors(org.apache.hadoop.mapred.Counters ctrs,
StringBuilder errMsg)
- Specified by:
checkFatalErrors
in interface HadoopJobExecHook
logPlanProgress
public void logPlanProgress(SessionState ss)
throws IOException
- Specified by:
logPlanProgress
in interface HadoopJobExecHook
- Throws:
IOException
Copyright © 2014 The Apache Software Foundation. All rights reserved.