public class TestHFileOutputFormat extends Object
KeyValueSortReducer
and HFileOutputFormat
.
Sets up and runs a mapreduce job that writes hfile output.
Creates a few inner classes to implement splits and an inputformat that
emits keys and values like those of PerformanceEvaluation
.Constructor and Description |
---|
TestHFileOutputFormat() |
Modifier and Type | Method and Description |
---|---|
static void |
main(String[] args) |
void |
manualTest(String[] args) |
void |
test_LATEST_TIMESTAMP_isReplaced()
Test that
HFileOutputFormat RecordWriter amends timestamps if
passed a keyvalue whose timestamp is HConstants.LATEST_TIMESTAMP . |
void |
test_TIMERANGE() |
void |
testColumnFamilySettings()
Test that
HFileOutputFormat RecordWriter uses compression and
bloom filter settings from the column family descriptor |
void |
testExcludeAllFromMinorCompaction()
This test is to test the scenario happened in HBASE-6901.
|
void |
testExcludeMinorCompaction() |
void |
testJobConfiguration() |
void |
testMRIncrementalLoad() |
void |
testMRIncrementalLoadWithSplit() |
void |
testSerializeDeserializeFamilyBlockSizeMap()
|
void |
testSerializeDeserializeFamilyBloomTypeMap()
|
void |
testSerializeDeserializeFamilyCompressionMap()
|
void |
testSerializeDeserializeFamilyDataBlockEncodingMap()
|
void |
testWritingPEData()
Run small MR job.
|
public void test_LATEST_TIMESTAMP_isReplaced() throws Exception
HFileOutputFormat
RecordWriter amends timestamps if
passed a keyvalue whose timestamp is HConstants.LATEST_TIMESTAMP
.Exception
public void testWritingPEData() throws Exception
Exception
public void testMRIncrementalLoadWithSplit() throws Exception
Exception
public void testSerializeDeserializeFamilyCompressionMap() throws IOException
HFileOutputFormat.configureCompression(org.apache.hadoop.hbase.client.Table,
Configuration)
and (Configuration)
.
Tests that the compression map is correctly serialized into
and deserialized from configurationIOException
public void testSerializeDeserializeFamilyBloomTypeMap() throws IOException
HFileOutputFormat.configureBloomType(org.apache.hadoop.hbase.client.Table,
Configuration)
and (Configuration)
.
Tests that the compression map is correctly serialized into
and deserialized from configurationIOException
public void testSerializeDeserializeFamilyBlockSizeMap() throws IOException
HFileOutputFormat.configureBlockSize(org.apache.hadoop.hbase.client.Table,
Configuration)
and (Configuration)
.
Tests that the compression map is correctly serialized into
and deserialized from configurationIOException
public void testSerializeDeserializeFamilyDataBlockEncodingMap() throws IOException
HFileOutputFormat.configureDataBlockEncoding(org.apache.hadoop.hbase.client.Table,
Configuration)
and (Configuration)
.
Tests that the compression map is correctly serialized into
and deserialized from configurationIOException
public void testColumnFamilySettings() throws Exception
HFileOutputFormat
RecordWriter uses compression and
bloom filter settings from the column family descriptorException
public void testExcludeAllFromMinorCompaction() throws Exception
Exception
public void testExcludeMinorCompaction() throws Exception
Exception