org.apache.hadoop.hbase

Class PerformanceEvaluation

java.lang.Object

Configured

org.apache.hadoop.hbase.PerformanceEvaluation

@InterfaceAudience.LimitedPrivate(value="Tools")
public class PerformanceEvaluation
extends Configured

Script used evaluating HBase performance and scalability. Runs a HBase client that steps through one of a set of hardcoded tests or 'experiments' (e.g. a random reads test, a random writes test, etc.). Pass on the command-line which test to run and how many clients are participating in this experiment. Run PerformanceEvaluation --help to obtain usage.

This class sets up and runs the evaluation programs described in Section 7, Performance Evaluation, of the Bigtable paper, pages 8-10.

By default, runs as a mapreduce job where each mapper runs a single test client. Can also run as a non-mapreduce, multithreaded application by specifying --nomapred. Each client does about 1GB of data, unless specified otherwise.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	PerformanceEvaluation.Counter Enum for map metrics.
static class	PerformanceEvaluation.EvaluationMapTask MapReduce job that runs a performance evaluation client in each map task.
protected static class	PerformanceEvaluation.RunResult

Field Summary

Fields

Modifier and Type	Field and Description
static byte[]	COLUMN_ZERO
static int	DEFAULT_VALUE_LENGTH
static byte[]	FAMILY_NAME
protected static Log	LOG
static byte[]	QUALIFIER_NAME
static int	ROW_LENGTH
static String	TABLE_NAME

Constructor Summary

Constructors

Constructor and Description
PerformanceEvaluation(Configuration conf) Constructor

Method Summary

Modifier and Type	Method and Description
protected static void	addCommandDescriptor(Class<? extends org.apache.hadoop.hbase.PerformanceEvaluation.Test> cmdClass, String name, String description)
static byte[]	format(int number)
static byte[]	generateData(Random r, int length)
static byte[]	generateValue(Random r) Deprecated. Use generateData(java.util.Random, int) instead.
protected static byte[][]	getSplits(org.apache.hadoop.hbase.PerformanceEvaluation.TestOptions opts) generates splits based on total number of rows and specified split regions
protected static HTableDescriptor	getTableDescriptor(org.apache.hadoop.hbase.PerformanceEvaluation.TestOptions opts) Create an HTableDescriptor from provided TestOptions.
static void	main(String[] args)
protected void	printUsage()
protected static void	printUsage(String message)
protected static void	printUsage(String className, String message)
protected static void	printUsageAndExit(String message, int exitCode)
int	run(String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final Log LOG

TABLE_NAME

public static final String TABLE_NAME

See Also:

Constant Field Values

FAMILY_NAME

public static final byte[] FAMILY_NAME

COLUMN_ZERO

public static final byte[] COLUMN_ZERO

QUALIFIER_NAME

public static final byte[] QUALIFIER_NAME

DEFAULT_VALUE_LENGTH

public static final int DEFAULT_VALUE_LENGTH

See Also:

Constant Field Values

ROW_LENGTH

public static final int ROW_LENGTH

See Also:

Constant Field Values

Constructor Detail

PerformanceEvaluation

public PerformanceEvaluation(Configuration conf)

Constructor

Parameters:

conf - Configuration object

Method Detail

addCommandDescriptor

protected static void addCommandDescriptor(Class<? extends org.apache.hadoop.hbase.PerformanceEvaluation.Test> cmdClass,
                                           String name,
                                           String description)

getTableDescriptor

protected static HTableDescriptor getTableDescriptor(org.apache.hadoop.hbase.PerformanceEvaluation.TestOptions opts)

Create an HTableDescriptor from provided TestOptions.

getSplits

protected static byte[][] getSplits(org.apache.hadoop.hbase.PerformanceEvaluation.TestOptions opts)

generates splits based on total number of rows and specified split regions

format

public static byte[] format(int number)

generateData

public static byte[] generateData(Random r,
                                  int length)

generateValue

@Deprecated
public static byte[] generateValue(Random r)

Deprecated. Use generateData(java.util.Random, int) instead.

Returns:

Generated random value to insert into a table cell.

printUsage

protected void printUsage()

printUsage

protected static void printUsage(String message)

printUsageAndExit

protected static void printUsageAndExit(String message,
                                        int exitCode)

printUsage

protected static void printUsage(String className,
                                 String message)

run

public int run(String[] args)
        throws Exception

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception