org.apache.hadoop.hive.ql.stats.jdbc
Class JDBCStatsPublisher

java.lang.Object
  org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher

All Implemented Interfaces:

StatsPublisher

public class JDBCStatsPublisher
extends Object
implements StatsPublisher

Constructor Summary

JDBCStatsPublisher()

Method Summary

boolean	closeConnection() This method closes the connection to the temporary storage.
boolean	connect(org.apache.hadoop.conf.Configuration hiveconf) This method connects to the intermediate statistics database.
boolean	init(org.apache.hadoop.conf.Configuration hconf) Initialize the intermediate stats DB for the first time it is running (e.g., creating tables.).
boolean	publishStat(String fileID, Map<String,String> stats) This method publishes a given statistic into a disk storage, possibly HBase or MySQL.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JDBCStatsPublisher

public JDBCStatsPublisher()

Method Detail

connect

public boolean connect(org.apache.hadoop.conf.Configuration hiveconf)

Description copied from interface: StatsPublisher

This method connects to the intermediate statistics database.

Specified by:

connect in interface StatsPublisher

Parameters:

hiveconf - HiveConf that contains the connection parameters.

Returns:

true if connection is successful, false otherwise.

publishStat

public boolean publishStat(String fileID,
                           Map<String,String> stats)

Description copied from interface: StatsPublisher

This method publishes a given statistic into a disk storage, possibly HBase or MySQL.

Specified by:

publishStat in interface StatsPublisher

Parameters:

fileID - : a string identification the statistics to be published by all mappers/reducers and then gathered. The statID is unique per output partition per task, e.g.,: the output directory name (uniq per FileSinkOperator) + the partition specs (only for dynamic partitions) + taskID (last component of task file)

stats - : a map containing key-value pairs, where key is a string representing the statistic to be published, and value is a string representing the value for the given statistic

Returns:

true if successful, false otherwise

closeConnection

public boolean closeConnection()

Description copied from interface: StatsPublisher

This method closes the connection to the temporary storage.

Specified by:

closeConnection in interface StatsPublisher

init

public boolean init(org.apache.hadoop.conf.Configuration hconf)

Initialize the intermediate stats DB for the first time it is running (e.g., creating tables.).

Specified by:

init in interface StatsPublisher

Parameters:

hconf - HiveConf that contains the configurations parameters used to connect to intermediate stats database.

Returns:

true if initialization is successful, false otherwise.