@InterfaceAudience.Public @InterfaceStability.Stable public class MultiTableOutputFormat extends <any>
Hadoop output format that writes to one or more HBase tables. The key is
taken to be the table name while the output value must be either a
Put
or a Delete
instance. All tables must already exist, and
all Puts and Deletes must reference only valid column families.
Write-ahead logging (WAL) for Puts can be disabled by setting
WAL_PROPERTY
to WAL_OFF
. Default value is WAL_ON
.
Note that disabling write-ahead logging is only appropriate for jobs where
loss of data due to region server failure can be tolerated (for example,
because it is easy to rerun a bulk import).
Modifier and Type | Class and Description |
---|---|
protected static class |
MultiTableOutputFormat.MultiTableRecordWriter
Record writer for outputting to multiple HTables.
|
Modifier and Type | Field and Description |
---|---|
static boolean |
WAL_OFF
Property value to disable write-ahead logging
|
static boolean |
WAL_ON
Property value to use write-ahead logging
|
static java.lang.String |
WAL_PROPERTY
Set this to
WAL_OFF to turn off write-ahead logging (WAL) |
Constructor and Description |
---|
MultiTableOutputFormat() |
Modifier and Type | Method and Description |
---|---|
void |
checkOutputSpecs(JobContext context) |
OutputCommitter |
getOutputCommitter(TaskAttemptContext context) |
<any> |
getRecordWriter(TaskAttemptContext context) |
public static final java.lang.String WAL_PROPERTY
WAL_OFF
to turn off write-ahead logging (WAL)public static final boolean WAL_ON
public static final boolean WAL_OFF
public void checkOutputSpecs(JobContext context) throws java.io.IOException, java.lang.InterruptedException
java.io.IOException
java.lang.InterruptedException
public OutputCommitter getOutputCommitter(TaskAttemptContext context) throws java.io.IOException, java.lang.InterruptedException
java.io.IOException
java.lang.InterruptedException
public <any> getRecordWriter(TaskAttemptContext context) throws java.io.IOException, java.lang.InterruptedException
java.io.IOException
java.lang.InterruptedException