public class HFileOutputFormat2
extends <any>
HFile
s. Calling write(null,null) will forcibly roll
all HFiles being written.
Using this class as part of a MapReduce job is best done
using configureIncrementalLoad(Job, TableDescriptor, RegionLocator)
.
Modifier and Type | Field and Description |
---|---|
static java.lang.String |
DATABLOCK_ENCODING_OVERRIDE_CONF_KEY |
static java.lang.String |
LOCALITY_SENSITIVE_CONF_KEY
Keep locality while generating HFiles for bulkload.
|
static java.lang.String |
STORAGE_POLICY_PROPERTY |
static java.lang.String |
STORAGE_POLICY_PROPERTY_CF_PREFIX |
protected static byte[] |
tableSeparator |
Constructor and Description |
---|
HFileOutputFormat2() |
Modifier and Type | Method and Description |
---|---|
protected static byte[] |
combineTableNameSuffix(byte[] tableName,
byte[] suffix) |
static void |
configureIncrementalLoad(Job job,
TableDescriptor tableDescriptor,
RegionLocator regionLocator)
Configure a MapReduce Job to perform an incremental load into the given
table.
|
static void |
configureIncrementalLoad(Job job,
Table table,
RegionLocator regionLocator)
Configure a MapReduce Job to perform an incremental load into the given
table.
|
static void |
configureIncrementalLoadMap(Job job,
TableDescriptor tableDescriptor) |
<any> |
getRecordWriter(TaskAttemptContext context) |
protected static byte[] |
getTableNameSuffixedWithFamily(byte[] tableName,
byte[] family) |
protected static final byte[] tableSeparator
public static final java.lang.String DATABLOCK_ENCODING_OVERRIDE_CONF_KEY
public static final java.lang.String LOCALITY_SENSITIVE_CONF_KEY
public static final java.lang.String STORAGE_POLICY_PROPERTY
public static final java.lang.String STORAGE_POLICY_PROPERTY_CF_PREFIX
protected static byte[] combineTableNameSuffix(byte[] tableName, byte[] suffix)
public <any> getRecordWriter(TaskAttemptContext context) throws java.io.IOException, java.lang.InterruptedException
java.io.IOException
java.lang.InterruptedException
protected static byte[] getTableNameSuffixedWithFamily(byte[] tableName, byte[] family)
public static void configureIncrementalLoad(Job job, Table table, RegionLocator regionLocator) throws java.io.IOException
java.io.IOException
public static void configureIncrementalLoad(Job job, TableDescriptor tableDescriptor, RegionLocator regionLocator) throws java.io.IOException
java.io.IOException
public static void configureIncrementalLoadMap(Job job, TableDescriptor tableDescriptor) throws java.io.IOException
java.io.IOException