org.apache.hadoop.hbase.backup.util

Class BackupServerUtil

java.lang.Object

org.apache.hadoop.hbase.backup.util.BackupServerUtil

@InterfaceAudience.Private
 @InterfaceStability.Evolving
public final class BackupServerUtil
extends java.lang.Object

A collection for methods used by multiple classes to backup HBase tables.

Field Summary

Fields

Modifier and Type	Field and Description
protected static Log	LOG
static java.lang.String	LOGNAME_SEPARATOR

Method Summary

Modifier and Type	Method and Description
static void	cleanupBackupData(BackupInfo context, Configuration conf)
static void	copyTableRegionInfo(BackupInfo backupContext, Configuration conf) copy out Table RegionInfo into incremental backup image need to consider move this logic into HBackupFileSystem
static long	getFilesLength(FileSystem fs, Path dir) Get the total length of files under the given directory recursively.
static java.util.List<java.lang.String>	getListOfWALFiles(Configuration c) Get list of all WAL files (WALs and archive)
static java.util.List<java.lang.String>	getListOfWALFiles(Configuration c, PathFilter filter) Get list of all WAL files (WALs and archive)
static java.util.HashMap<java.lang.String,java.lang.Long>	getRSLogTimestampMins(java.util.HashMap<TableName,java.util.HashMap<java.lang.String,java.lang.Long>> rsLogTimestampMap) Loop through the RS log timestamp map for the tables, for each RS, find the min timestamp value for the RS among the tables.
static java.lang.String	getUniqueWALFileNamePart(Path p) Returns WAL file name
static java.lang.String	getUniqueWALFileNamePart(java.lang.String walFileName) Returns WAL file name
static java.util.List<java.lang.String>	getWALFilesOlderThan(Configuration c, java.util.HashMap<java.lang.String,java.lang.Long> hostTimestampMap) Get list of all old WAL files (WALs and archive)
static java.lang.String	join(TableName[] names)
static java.lang.String	parseHostNameFromLogFile(Path p) TODO: return hostname:port
static TableName[]	parseTableNames(java.lang.String tables)
static java.util.ArrayList<BackupInfo>	sortHistoryListDesc(java.util.ArrayList<BackupInfo> historyList) Sort history list by start time in descending order.
static void	waitForSnapshot(HBaseProtos.SnapshotDescription snapshot, long max, SnapshotManager snapshotMgr, Configuration conf)
static void	writeRegioninfoOnFilesystem(Configuration conf, FileSystem fs, Path regionInfoDir, HRegionInfo regionInfo) Write the .regioninfo file on-disk.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final Log LOG

LOGNAME_SEPARATOR

public static final java.lang.String LOGNAME_SEPARATOR

See Also:

Constant Field Values

Method Detail

waitForSnapshot

public static void waitForSnapshot(HBaseProtos.SnapshotDescription snapshot,
                                   long max,
                                   SnapshotManager snapshotMgr,
                                   Configuration conf)
                            throws java.io.IOException

Throws:

java.io.IOException

getRSLogTimestampMins

public static java.util.HashMap<java.lang.String,java.lang.Long> getRSLogTimestampMins(java.util.HashMap<TableName,java.util.HashMap<java.lang.String,java.lang.Long>> rsLogTimestampMap)

Loop through the RS log timestamp map for the tables, for each RS, find the min timestamp value for the RS among the tables.

Parameters:

rsLogTimestampMap - timestamp map

Returns:

the min timestamp of each RS

copyTableRegionInfo

public static void copyTableRegionInfo(BackupInfo backupContext,
                                       Configuration conf)
                                throws java.io.IOException,
                                       java.lang.InterruptedException

copy out Table RegionInfo into incremental backup image need to consider move this logic into HBackupFileSystem

Parameters:

backupContext - backup context

conf - configuration

Throws:

java.io.IOException - exception

java.lang.InterruptedException - exception

writeRegioninfoOnFilesystem

public static void writeRegioninfoOnFilesystem(Configuration conf,
                                               FileSystem fs,
                                               Path regionInfoDir,
                                               HRegionInfo regionInfo)
                                        throws java.io.IOException

Write the .regioninfo file on-disk.

Throws:

java.io.IOException

parseHostNameFromLogFile

public static java.lang.String parseHostNameFromLogFile(Path p)
                                                 throws java.io.IOException

TODO: return hostname:port

Parameters:

p -

Returns:

host name: port

Throws:

java.io.IOException

getUniqueWALFileNamePart

public static java.lang.String getUniqueWALFileNamePart(java.lang.String walFileName)
                                                 throws java.io.IOException

Returns WAL file name

Parameters:

walFileName - WAL file name

Returns:

WAL file name

Throws:

java.io.IOException - exception

java.lang.IllegalArgumentException - exception

getUniqueWALFileNamePart

public static java.lang.String getUniqueWALFileNamePart(Path p)
                                                 throws java.io.IOException

Returns WAL file name

Parameters:

p - - WAL file path

Returns:

WAL file name

Throws:

java.io.IOException - exception

getFilesLength

public static long getFilesLength(FileSystem fs,
                                  Path dir)
                           throws java.io.IOException

Get the total length of files under the given directory recursively.

Parameters:

fs - The hadoop file system

dir - The target directory

Returns:

the total length of files

Throws:

java.io.IOException - exception

sortHistoryListDesc

public static java.util.ArrayList<BackupInfo> sortHistoryListDesc(java.util.ArrayList<BackupInfo> historyList)

Sort history list by start time in descending order.

Parameters:

historyList - history list

Returns:

sorted list of BackupCompleteData

getListOfWALFiles

public static java.util.List<java.lang.String> getListOfWALFiles(Configuration c)
                                                          throws java.io.IOException

Get list of all WAL files (WALs and archive)

Parameters:

c - - configuration

Returns:

list of WAL files

Throws:

java.io.IOException - exception

getListOfWALFiles

public static java.util.List<java.lang.String> getListOfWALFiles(Configuration c,
                                                                 PathFilter filter)
                                                          throws java.io.IOException

Get list of all WAL files (WALs and archive)

Parameters:

c - - configuration

Returns:

list of WAL files

Throws:

java.io.IOException - exception

getWALFilesOlderThan

public static java.util.List<java.lang.String> getWALFilesOlderThan(Configuration c,
                                                                    java.util.HashMap<java.lang.String,java.lang.Long> hostTimestampMap)
                                                             throws java.io.IOException

Get list of all old WAL files (WALs and archive)

Parameters:

c - - configuration

hostTimestampMap - - host timestamp map

Returns:

list of WAL files

Throws:

java.io.IOException - exception

join

public static java.lang.String join(TableName[] names)

parseTableNames

public static TableName[] parseTableNames(java.lang.String tables)

cleanupBackupData

public static void cleanupBackupData(BackupInfo context,
                                     Configuration conf)
                              throws java.io.IOException

Throws:

java.io.IOException