public class TestHFileOutputFormat2 extends Object
CellSortReducer
and HFileOutputFormat2
.
Sets up and runs a mapreduce job that writes hfile output.
Creates a few inner classes to implement splits and an inputformat that
emits keys and values like those of PerformanceEvaluation
.Constructor and Description |
---|
TestHFileOutputFormat2() |
Modifier and Type | Method and Description |
---|---|
static void |
main(String[] args) |
void |
manualTest(String[] args) |
void |
test_LATEST_TIMESTAMP_isReplaced()
Test that
HFileOutputFormat2 RecordWriter amends timestamps if
passed a keyvalue whose timestamp is HConstants.LATEST_TIMESTAMP . |
void |
test_TIMERANGE() |
void |
testColumnFamilySettings()
Test that
HFileOutputFormat2 RecordWriter uses compression and
bloom filter settings from the column family descriptor |
void |
testExcludeAllFromMinorCompaction()
This test is to test the scenario happened in HBASE-6901.
|
void |
testExcludeMinorCompaction() |
void |
testJobConfiguration() |
void |
testMRIncrementalLoad() |
void |
testMRIncrementalLoadWithSplit() |
void |
testSerializeDeserializeFamilyBlockSizeMap()
Test for
HFileOutputFormat2#configureBlockSize(org.apache.hadoop.hbase.client.Table,
Configuration) and (Configuration) . |
void |
testSerializeDeserializeFamilyBloomTypeMap()
Test for
HFileOutputFormat2#configureBloomType(org.apache.hadoop.hbase.client.Table,
Configuration) and (Configuration) . |
void |
testSerializeDeserializeFamilyCompressionMap()
Test for
HFileOutputFormat2#configureCompression(org.apache.hadoop.hbase.client.Table,
Configuration) and (Configuration) . |
void |
testSerializeDeserializeFamilyDataBlockEncodingMap()
|
void |
testWritingPEData()
Run small MR job.
|
public void test_LATEST_TIMESTAMP_isReplaced() throws Exception
HFileOutputFormat2
RecordWriter amends timestamps if
passed a keyvalue whose timestamp is HConstants.LATEST_TIMESTAMP
.Exception
public void testWritingPEData() throws Exception
Exception
public void testMRIncrementalLoadWithSplit() throws Exception
Exception
public void testSerializeDeserializeFamilyCompressionMap() throws IOException
HFileOutputFormat2#configureCompression(org.apache.hadoop.hbase.client.Table,
Configuration)
and (Configuration)
.
Tests that the compression map is correctly serialized into
and deserialized from configurationIOException
public void testSerializeDeserializeFamilyBloomTypeMap() throws IOException
HFileOutputFormat2#configureBloomType(org.apache.hadoop.hbase.client.Table,
Configuration)
and (Configuration)
.
Tests that the compression map is correctly serialized into
and deserialized from configurationIOException
public void testSerializeDeserializeFamilyBlockSizeMap() throws IOException
HFileOutputFormat2#configureBlockSize(org.apache.hadoop.hbase.client.Table,
Configuration)
and (Configuration)
.
Tests that the compression map is correctly serialized into
and deserialized from configurationIOException
public void testSerializeDeserializeFamilyDataBlockEncodingMap() throws IOException
HFileOutputFormat2.configureDataBlockEncoding(HTableDescriptor, Configuration)
and HFileOutputFormat2.createFamilyDataBlockEncodingMap(Configuration)
.
Tests that the compression map is correctly serialized into
and deserialized from configurationIOException
public void testColumnFamilySettings() throws Exception
HFileOutputFormat2
RecordWriter uses compression and
bloom filter settings from the column family descriptorException
public void testExcludeAllFromMinorCompaction() throws Exception
Exception
public void testExcludeMinorCompaction() throws Exception
Exception