org.apache.hadoop.hive.ql.exec.mr
Class ExecMapper

java.lang.Object
  org.apache.hadoop.mapred.MapReduceBase
      org.apache.hadoop.hive.ql.exec.mr.ExecMapper

All Implemented Interfaces:

Closeable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper

public class ExecMapper
extends org.apache.hadoop.mapred.MapReduceBase
implements org.apache.hadoop.mapred.Mapper

ExecMapper is the generic Map class for Hive. Together with ExecReducer it is the bridge between the map-reduce framework and the Hive operator pipeline at execution time. It's main responsabilities are: - Load and setup the operator pipeline from XML - Run the pipeline by transforming key value pairs to records and forwarding them to the operators - Stop execution when the "limit" is reached - Catch and handle errors during execution of the operators.

Nested Class Summary

static class

ExecMapper.reportStats reportStats.

Field Summary

static org.apache.commons.logging.Log	l4j
static MemoryMXBean	memoryMXBean

Constructor Summary

ExecMapper()

Method Summary

void	close()
void	configure(org.apache.hadoop.mapred.JobConf job)
static boolean	getDone()
boolean	isAbort()
void	map(Object key, Object value, org.apache.hadoop.mapred.OutputCollector output, org.apache.hadoop.mapred.Reporter reporter)
void	setAbort(boolean abort)
static void	setDone(boolean done)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

l4j

public static final org.apache.commons.logging.Log l4j

memoryMXBean

public static MemoryMXBean memoryMXBean

Constructor Detail

ExecMapper

public ExecMapper()

Method Detail

configure

public void configure(org.apache.hadoop.mapred.JobConf job)

Specified by:

configure in interface org.apache.hadoop.mapred.JobConfigurable

Overrides:

configure in class org.apache.hadoop.mapred.MapReduceBase

map

public void map(Object key,
                Object value,
                org.apache.hadoop.mapred.OutputCollector output,
                org.apache.hadoop.mapred.Reporter reporter)
         throws IOException

Specified by:

map in interface org.apache.hadoop.mapred.Mapper

Throws:

IOException

close

public void close()

Specified by:

close in interface Closeable

Overrides:

close in class org.apache.hadoop.mapred.MapReduceBase

getDone

public static boolean getDone()

isAbort

public boolean isAbort()

setAbort

public void setAbort(boolean abort)

setDone

public static void setDone(boolean done)