org.apache.hadoop.hive.ql.io
Class HiveNullValueSequenceFileOutputFormat<K,V>

java.lang.Object
  extended by org.apache.hadoop.mapred.FileOutputFormat<K,V>
      extended by org.apache.hadoop.mapred.SequenceFileOutputFormat<K,V>
          extended by org.apache.hadoop.hive.ql.io.HiveNullValueSequenceFileOutputFormat<K,V>
All Implemented Interfaces:
HiveOutputFormat<K,V>, org.apache.hadoop.mapred.OutputFormat<K,V>

public class HiveNullValueSequenceFileOutputFormat<K,V>
extends org.apache.hadoop.mapred.SequenceFileOutputFormat<K,V>
implements HiveOutputFormat<K,V>

A HiveOutputFormat that writes SequenceFiles with the content saved in the keys, and null in the values.


Nested Class Summary
 
Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileOutputFormat
org.apache.hadoop.mapred.FileOutputFormat.Counter
 
Constructor Summary
HiveNullValueSequenceFileOutputFormat()
           
 
Method Summary
 FileSinkOperator.RecordWriter getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc, org.apache.hadoop.fs.Path finalOutPath, Class<? extends org.apache.hadoop.io.Writable> valueClass, boolean isCompressed, Properties tableProperties, org.apache.hadoop.util.Progressable progress)
          create the final out file and get some specific settings.
 
Methods inherited from class org.apache.hadoop.mapred.SequenceFileOutputFormat
getOutputCompressionType, getReaders, getRecordWriter, setOutputCompressionType
 
Methods inherited from class org.apache.hadoop.mapred.FileOutputFormat
checkOutputSpecs, getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath, setWorkOutputPath
 
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 
Methods inherited from interface org.apache.hadoop.mapred.OutputFormat
checkOutputSpecs, getRecordWriter
 

Constructor Detail

HiveNullValueSequenceFileOutputFormat

public HiveNullValueSequenceFileOutputFormat()
Method Detail

getHiveRecordWriter

public FileSinkOperator.RecordWriter getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc,
                                                         org.apache.hadoop.fs.Path finalOutPath,
                                                         Class<? extends org.apache.hadoop.io.Writable> valueClass,
                                                         boolean isCompressed,
                                                         Properties tableProperties,
                                                         org.apache.hadoop.util.Progressable progress)
                                                  throws IOException
Description copied from interface: HiveOutputFormat
create the final out file and get some specific settings.

Specified by:
getHiveRecordWriter in interface HiveOutputFormat<K,V>
Parameters:
jc - the job configuration file
finalOutPath - the final output file to be created
valueClass - the value class used for create
isCompressed - whether the content is compressed or not
tableProperties - the table properties of this file's corresponding table
progress - progress used for status report
Returns:
the RecordWriter for the output file
Throws:
IOException


Copyright © 2014 The Apache Software Foundation. All rights reserved.