org.apache.hadoop.hive.ql.io.orc
Class OrcOutputFormat
java.lang.Object
org.apache.hadoop.mapred.FileOutputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow>
org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat
- All Implemented Interfaces:
- AcidOutputFormat<org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow>, HiveOutputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow>, org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow>
public class OrcOutputFormat
- extends org.apache.hadoop.mapred.FileOutputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow>
- implements AcidOutputFormat<org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow>
A Hive OutputFormat for ORC files.
Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileOutputFormat |
org.apache.hadoop.mapred.FileOutputFormat.Counter |
Method Summary |
StatsProvidingRecordWriter |
getHiveRecordWriter(org.apache.hadoop.mapred.JobConf conf,
org.apache.hadoop.fs.Path path,
Class<? extends org.apache.hadoop.io.Writable> valueClass,
boolean isCompressed,
Properties tableProperties,
org.apache.hadoop.util.Progressable reporter)
create the final out file and get some specific settings. |
FileSinkOperator.RecordWriter |
getRawRecordWriter(org.apache.hadoop.fs.Path path,
AcidOutputFormat.Options options)
Create a raw writer for ACID events. |
RecordUpdater |
getRecordUpdater(org.apache.hadoop.fs.Path path,
AcidOutputFormat.Options options)
Create a RecordUpdater for inserting, updating, or deleting records. |
org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.NullWritable,org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow> |
getRecordWriter(org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.mapred.JobConf conf,
String name,
org.apache.hadoop.util.Progressable reporter)
|
Methods inherited from class org.apache.hadoop.mapred.FileOutputFormat |
checkOutputSpecs, getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath, setWorkOutputPath |
Methods inherited from interface org.apache.hadoop.mapred.OutputFormat |
checkOutputSpecs |
OrcOutputFormat
public OrcOutputFormat()
getRecordWriter
public org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.NullWritable,org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow> getRecordWriter(org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.mapred.JobConf conf,
String name,
org.apache.hadoop.util.Progressable reporter)
throws IOException
- Specified by:
getRecordWriter
in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow>
- Specified by:
getRecordWriter
in class org.apache.hadoop.mapred.FileOutputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow>
- Throws:
IOException
getHiveRecordWriter
public StatsProvidingRecordWriter getHiveRecordWriter(org.apache.hadoop.mapred.JobConf conf,
org.apache.hadoop.fs.Path path,
Class<? extends org.apache.hadoop.io.Writable> valueClass,
boolean isCompressed,
Properties tableProperties,
org.apache.hadoop.util.Progressable reporter)
throws IOException
- Description copied from interface:
HiveOutputFormat
- create the final out file and get some specific settings.
- Specified by:
getHiveRecordWriter
in interface HiveOutputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow>
- Parameters:
conf
- the job configuration filepath
- the final output file to be createdvalueClass
- the value class used for createisCompressed
- whether the content is compressed or nottableProperties
- the table properties of this file's corresponding tablereporter
- progress used for status report
- Returns:
- the RecordWriter for the output file
- Throws:
IOException
getRecordUpdater
public RecordUpdater getRecordUpdater(org.apache.hadoop.fs.Path path,
AcidOutputFormat.Options options)
throws IOException
- Description copied from interface:
AcidOutputFormat
- Create a RecordUpdater for inserting, updating, or deleting records.
- Specified by:
getRecordUpdater
in interface AcidOutputFormat<org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow>
- Parameters:
path
- the partition directory nameoptions
- the options for the writer
- Returns:
- the RecordUpdater for the output file
- Throws:
IOException
getRawRecordWriter
public FileSinkOperator.RecordWriter getRawRecordWriter(org.apache.hadoop.fs.Path path,
AcidOutputFormat.Options options)
throws IOException
- Description copied from interface:
AcidOutputFormat
- Create a raw writer for ACID events.
This is only intended for the compactor.
- Specified by:
getRawRecordWriter
in interface AcidOutputFormat<org.apache.hadoop.hive.ql.io.orc.OrcSerde.OrcSerdeRow>
- Parameters:
path
- the root directoryoptions
- options for writing the file
- Returns:
- a record writer
- Throws:
IOException
Copyright © 2014 The Apache Software Foundation. All rights reserved.