public class TestHFileOutputFormat2
extends java.lang.Object
CellSortReducer
and HFileOutputFormat2
.
Sets up and runs a mapreduce job that writes hfile output.
Creates a few inner classes to implement splits and an inputformat that
emits keys and values like those of PerformanceEvaluation
.Constructor and Description |
---|
TestHFileOutputFormat2() |
Modifier and Type | Method and Description |
---|---|
static void |
main(java.lang.String[] args) |
void |
manualTest(java.lang.String[] args) |
void |
test_LATEST_TIMESTAMP_isReplaced()
Test that
HFileOutputFormat2 RecordWriter amends timestamps if
passed a keyvalue whose timestamp is HConstants.LATEST_TIMESTAMP . |
void |
test_TIMERANGE() |
void |
test_WritingTagData()
Test that
HFileOutputFormat2 RecordWriter writes tags such as ttl into
hfile. |
void |
testColumnFamilySettings()
Test that
HFileOutputFormat2 RecordWriter uses compression and
bloom filter settings from the column family descriptor |
void |
testExcludeAllFromMinorCompaction()
This test is to test the scenario happened in HBASE-6901.
|
void |
testExcludeMinorCompaction() |
void |
testJobConfiguration() |
void |
testMRIncrementalLoad() |
void |
testMRIncrementalLoadWithSplit() |
void |
testSerializeDeserializeFamilyBlockSizeMap()
Test for
HFileOutputFormat2#configureBlockSize(org.apache.hadoop.hbase.client.Table,
Configuration) and (Configuration) . |
void |
testSerializeDeserializeFamilyBloomTypeMap()
Test for
HFileOutputFormat2#configureBloomType(org.apache.hadoop.hbase.client.Table,
Configuration) and (Configuration) . |
void |
testSerializeDeserializeFamilyCompressionMap()
Test for
HFileOutputFormat2#configureCompression(org.apache.hadoop.hbase.client.Table,
Configuration) and (Configuration) . |
void |
testSerializeDeserializeFamilyDataBlockEncodingMap()
|
void |
testWritingPEData()
Run small MR job.
|
public void test_LATEST_TIMESTAMP_isReplaced() throws java.lang.Exception
HFileOutputFormat2
RecordWriter amends timestamps if
passed a keyvalue whose timestamp is HConstants.LATEST_TIMESTAMP
.java.lang.Exception
public void test_TIMERANGE() throws java.lang.Exception
java.lang.Exception
public void testWritingPEData() throws java.lang.Exception
java.lang.Exception
public void test_WritingTagData() throws java.lang.Exception
HFileOutputFormat2
RecordWriter writes tags such as ttl into
hfile.java.lang.Exception
public void testJobConfiguration() throws java.lang.Exception
java.lang.Exception
public void testMRIncrementalLoad() throws java.lang.Exception
java.lang.Exception
public void testMRIncrementalLoadWithSplit() throws java.lang.Exception
java.lang.Exception
public void testSerializeDeserializeFamilyCompressionMap() throws java.io.IOException
HFileOutputFormat2#configureCompression(org.apache.hadoop.hbase.client.Table,
Configuration)
and (Configuration)
.
Tests that the compression map is correctly serialized into
and deserialized from configurationjava.io.IOException
public void testSerializeDeserializeFamilyBloomTypeMap() throws java.io.IOException
HFileOutputFormat2#configureBloomType(org.apache.hadoop.hbase.client.Table,
Configuration)
and (Configuration)
.
Tests that the compression map is correctly serialized into
and deserialized from configurationjava.io.IOException
public void testSerializeDeserializeFamilyBlockSizeMap() throws java.io.IOException
HFileOutputFormat2#configureBlockSize(org.apache.hadoop.hbase.client.Table,
Configuration)
and (Configuration)
.
Tests that the compression map is correctly serialized into
and deserialized from configurationjava.io.IOException
public void testSerializeDeserializeFamilyDataBlockEncodingMap() throws java.io.IOException
HFileOutputFormat2.configureDataBlockEncoding(HTableDescriptor, Configuration)
and HFileOutputFormat2.createFamilyDataBlockEncodingMap(Configuration)
.
Tests that the compression map is correctly serialized into
and deserialized from configurationjava.io.IOException
public void testColumnFamilySettings() throws java.lang.Exception
HFileOutputFormat2
RecordWriter uses compression and
bloom filter settings from the column family descriptorjava.lang.Exception
public void testExcludeAllFromMinorCompaction() throws java.lang.Exception
java.lang.Exception
public void testExcludeMinorCompaction() throws java.lang.Exception
java.lang.Exception
public static void main(java.lang.String[] args) throws java.lang.Exception
java.lang.Exception
public void manualTest(java.lang.String[] args) throws java.lang.Exception
java.lang.Exception