Cloudera Docs

Kafka Producer Metrics

Reference information for Kafka Producer Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

For example, the following metric names may be valid for Kafka Producer:

  • kafka_messages_received_from_producer_15min_rate_across_clusters
  • total_kafka_messages_received_from_producer_15min_rate_across_clusters

Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a certain service or role.

kafka_messages_received_from_producer_15min_rate

Description
Number of messages received from a producer: 15 Min Rate
Unit
messages per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_broker_topic_partition, kafka_topic, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_messages_received_from_producer_1min_rate

Description
Number of messages received from a producer: 1 Min Rate
Unit
messages per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_broker_topic_partition, kafka_topic, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_messages_received_from_producer_5min_rate

Description
Number of messages received from a producer: 5 Min Rate
Unit
messages per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_broker_topic_partition, kafka_topic, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_messages_received_from_producer_avg_rate

Description
Number of messages received from a producer: Avg Rate
Unit
messages per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_broker_topic_partition, kafka_topic, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_messages_received_from_producer_rate

Description
Number of messages received from a producer
Unit
messages per second
Parents
cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_broker_topic_partition, kafka_topic, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)