Kafka Consumer Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

For example, the following metric names may be valid for Kafka Consumer:

  • kafka_consumer_committed_offset_15min_rate_across_kafka_consumer_groups
  • total_kafka_consumer_committed_offset_15min_rate_across_kafka_consumer_groups

Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a certain service or role.

Metric Name Description Unit Parents CDH Version
kafka_consumer_committed_offset_15min_rate The offset committed by consumer: 15 Min Rate message.units.offset per message.units.singular.second kafka_consumer_group CDH 5, CDH 6, CDH 7
kafka_consumer_committed_offset_1min_rate The offset committed by consumer: 1 Min Rate message.units.offset per message.units.singular.second kafka_consumer_group CDH 5, CDH 6, CDH 7
kafka_consumer_committed_offset_5min_rate The offset committed by consumer: 5 Min Rate message.units.offset per message.units.singular.second kafka_consumer_group CDH 5, CDH 6, CDH 7
kafka_consumer_committed_offset_avg_rate The offset committed by consumer: Avg Rate message.units.offset per message.units.singular.second kafka_consumer_group CDH 5, CDH 6, CDH 7
kafka_consumer_committed_offset_rate The offset committed by consumer message.units.offset per second kafka_consumer_group CDH 5, CDH 6, CDH 7
kafka_consumer_lag_15min_rate Consumer Lag: 15 Min Rate messages per message.units.singular.second kafka_consumer_group CDH 5, CDH 6, CDH 7
kafka_consumer_lag_1min_rate Consumer Lag: 1 Min Rate messages per message.units.singular.second kafka_consumer_group CDH 5, CDH 6, CDH 7
kafka_consumer_lag_5min_rate Consumer Lag: 5 Min Rate messages per message.units.singular.second kafka_consumer_group CDH 5, CDH 6, CDH 7
kafka_consumer_lag_avg_rate Consumer Lag: Avg Rate messages per message.units.singular.second kafka_consumer_group CDH 5, CDH 6, CDH 7
kafka_consumer_lag_rate Consumer Lag messages per second kafka_consumer_group CDH 5, CDH 6, CDH 7