org.apache.hadoop.hive.ql.exec
Class FileSinkOperator

java.lang.Object
  org.apache.hadoop.hive.ql.exec.Operator<T>
      org.apache.hadoop.hive.ql.exec.TerminalOperator<FileSinkDesc>
          org.apache.hadoop.hive.ql.exec.FileSinkOperator

All Implemented Interfaces:

Serializable, Cloneable, Node

Direct Known Subclasses:

VectorFileSinkOperator

public class FileSinkOperator
extends TerminalOperator<FileSinkDesc>
implements Serializable

File Sink operator implementation.

See Also:

Serialized Form

Nested Class Summary

class	FileSinkOperator.FSPaths
static interface	FileSinkOperator.RecordWriter RecordWriter.

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.OperatorFunc, Operator.State

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

HIVECOUNTERCREATEDFILES, HIVECOUNTERFATAL

Constructor Summary

FileSinkOperator()

Method Summary

void	augmentPlan() Called during semantic analysis as operators are being added in order to give them a chance to compute any additional plan information needed.
void	checkOutputSpecs(org.apache.hadoop.fs.FileSystem ignored, org.apache.hadoop.mapred.JobConf job)
void	closeOp(boolean abort) Operator specific close routine.
String	getName() Implements the getName function for the Node Interface.
static String	getOperatorName()
org.apache.hadoop.hive.ql.plan.api.OperatorType	getType() Return the type of the specific operator among the types in OperatorType.
void	jobCloseOp(org.apache.hadoop.conf.Configuration hconf, boolean success)
void	processOp(Object row, int tag) Process the row.
void	startGroup()

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

acceptLimitPushdown, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, dump, dump, endGroup, flush, getChildOperators, getChildren, getColumnExprMap, getConf, getConfiguration, getDone, getExecContext, getGroupKeyObject, getGroupKeyObjectInspector, getIdentifier, getInputObjInspectors, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getSchema, getStatistics, getStats, initialize, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeChildren, removeParent, replaceChild, replaceParent, reset, resetId, resetStats, setAlias, setChildOperators, setColumnExprMap, setConf, setExecContext, setGroupKeyObject, setGroupKeyObjectInspector, setId, setInputObjInspectors, setOperatorId, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

FileSinkOperator

public FileSinkOperator()

Method Detail

processOp

public void processOp(Object row,
                      int tag)
               throws HiveException

Description copied from class: Operator

Process the row.

Specified by:

processOp in class Operator<FileSinkDesc>

Parameters:

row - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

startGroup

public void startGroup()
                throws HiveException

Overrides:

startGroup in class Operator<FileSinkDesc>

Throws:

HiveException

closeOp

public void closeOp(boolean abort)
             throws HiveException

Description copied from class: Operator

Operator specific close routine. Operators which inherents this class should overwrite this funtion for their specific cleanup routine.

Throws:

HiveException

getName

public String getName()

Description copied from class: Operator

Implements the getName function for the Node Interface.

Specified by:

getName in interface Node

Overrides:

getName in class Operator<FileSinkDesc>

Returns:

the name of the operator

getOperatorName

public static String getOperatorName()

jobCloseOp

public void jobCloseOp(org.apache.hadoop.conf.Configuration hconf,
                       boolean success)
                throws HiveException

Overrides:

jobCloseOp in class Operator<FileSinkDesc>

Throws:

HiveException

getType

public org.apache.hadoop.hive.ql.plan.api.OperatorType getType()

Description copied from class: Operator

Return the type of the specific operator among the types in OperatorType.

Specified by:

getType in class Operator<FileSinkDesc>

Returns:

OperatorType.*

augmentPlan

public void augmentPlan()

Description copied from class: Operator

Called during semantic analysis as operators are being added in order to give them a chance to compute any additional plan information needed. Does nothing by default.

Overrides:

augmentPlan in class Operator<FileSinkDesc>

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.fs.FileSystem ignored,
                             org.apache.hadoop.mapred.JobConf job)
                      throws IOException

Throws:

IOException