Flume Sink Metrics

Reference information for Flume Sink Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

For example, the following metric names may be valid for Flume Sink:

  • batch_complete_rate_across_agents
  • total_batch_complete_rate_across_agents

Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a certain service or role.

batch_complete_rate

Description
The number of append batches attempted containing the maximum number of events supported by the next hop.
Unit
batches per second
Parents
agent, cluster, flume, flume_sink_tier, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

batch_empty_rate

Description
The number of append batches attempted containing zero events.
Unit
batches per second
Parents
agent, cluster, flume, flume_sink_tier, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

batch_underflow_rate

Description
The number of append batches attempted containing less than the maximum number of events supported by the next hop.
Unit
batches per second
Parents
agent, cluster, flume, flume_sink_tier, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

connection_closed_rate

Description
The number of connections closed by this sink.
Unit
connections per second
Parents
agent, cluster, flume, flume_sink_tier, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

connection_created_rate

Description
The number of connections created by this sink. Only applicable to some sink types.
Unit
connections per second
Parents
agent, cluster, flume, flume_sink_tier, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

connection_failed_rate

Description
The number of failed connections.
Unit
connections per second
Parents
agent, cluster, flume, flume_sink_tier, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

event_drain_attempt_rate

Description
The total number of events that have been attempted to be drained to the next hop.
Unit
events per second
Parents
agent, cluster, flume, flume_sink_tier, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

event_drain_success_rate

Description
The total number of events that have successfully been drained to the next hop.
Unit
events per second
Parents
agent, cluster, flume, flume_sink_tier, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)