org.apache.hadoop.hive.ql.io
Class VectorizedRCFileInputFormat
java.lang.Object
org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.NullWritable,VectorizedRowBatch>
org.apache.hadoop.hive.ql.io.VectorizedRCFileInputFormat
- All Implemented Interfaces:
- InputFormatChecker, org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.NullWritable,VectorizedRowBatch>
public class VectorizedRCFileInputFormat
- extends org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.NullWritable,VectorizedRowBatch>
- implements InputFormatChecker
A MapReduce/Hive Vectorized input format for RC files.
Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat |
org.apache.hadoop.mapred.FileInputFormat.Counter |
Fields inherited from class org.apache.hadoop.mapred.FileInputFormat |
INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES |
Method Summary |
org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.NullWritable,VectorizedRowBatch> |
getRecordReader(org.apache.hadoop.mapred.InputSplit split,
org.apache.hadoop.mapred.JobConf job,
org.apache.hadoop.mapred.Reporter reporter)
|
boolean |
validateInput(org.apache.hadoop.fs.FileSystem fs,
HiveConf conf,
ArrayList<org.apache.hadoop.fs.FileStatus> files)
This method is used to validate the input files. |
Methods inherited from class org.apache.hadoop.mapred.FileInputFormat |
addInputPath, addInputPaths, getInputPathFilter, getInputPaths, getSplits, setInputPathFilter, setInputPaths, setInputPaths |
VectorizedRCFileInputFormat
public VectorizedRCFileInputFormat()
getRecordReader
public org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.NullWritable,VectorizedRowBatch> getRecordReader(org.apache.hadoop.mapred.InputSplit split,
org.apache.hadoop.mapred.JobConf job,
org.apache.hadoop.mapred.Reporter reporter)
throws IOException
- Specified by:
getRecordReader
in interface org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.NullWritable,VectorizedRowBatch>
- Specified by:
getRecordReader
in class org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.NullWritable,VectorizedRowBatch>
- Throws:
IOException
validateInput
public boolean validateInput(org.apache.hadoop.fs.FileSystem fs,
HiveConf conf,
ArrayList<org.apache.hadoop.fs.FileStatus> files)
throws IOException
- Description copied from interface:
InputFormatChecker
- This method is used to validate the input files.
- Specified by:
validateInput
in interface InputFormatChecker
- Throws:
IOException
Copyright © 2014 The Apache Software Foundation. All rights reserved.