org.apache.hadoop.hive.ql.io.rcfile.stats
Class PartialScanMapper
java.lang.Object
org.apache.hadoop.mapred.MapReduceBase
org.apache.hadoop.hive.ql.io.rcfile.stats.PartialScanMapper
- All Implemented Interfaces:
- Closeable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper<Object,RCFileValueBufferWrapper,Object,Object>
public class PartialScanMapper
- extends org.apache.hadoop.mapred.MapReduceBase
- implements org.apache.hadoop.mapred.Mapper<Object,RCFileValueBufferWrapper,Object,Object>
PartialScanMapper.
It reads through block header and aggregates statistics at the end.
https://issues.apache.org/jira/browse/HIVE-3958
Field Summary |
static org.apache.commons.logging.Log |
LOG
|
LOG
public static final org.apache.commons.logging.Log LOG
PartialScanMapper
public PartialScanMapper()
configure
public void configure(org.apache.hadoop.mapred.JobConf job)
- Specified by:
configure
in interface org.apache.hadoop.mapred.JobConfigurable
- Overrides:
configure
in class org.apache.hadoop.mapred.MapReduceBase
map
public void map(Object k,
RCFileValueBufferWrapper value,
org.apache.hadoop.mapred.OutputCollector<Object,Object> output,
org.apache.hadoop.mapred.Reporter reporter)
throws IOException
- Specified by:
map
in interface org.apache.hadoop.mapred.Mapper<Object,RCFileValueBufferWrapper,Object,Object>
- Throws:
IOException
close
public void close()
throws IOException
- Specified by:
close
in interface Closeable
- Overrides:
close
in class org.apache.hadoop.mapred.MapReduceBase
- Throws:
IOException
Copyright © 2014 The Apache Software Foundation. All rights reserved.