Kafka Broker Topic Metrics

Reference information for Kafka Broker Topic Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

For example, the following metric names may be valid for Kafka Broker Topic:

  • kafka_bytes_fetched_15min_rate_across_clusters
  • total_kafka_bytes_fetched_15min_rate_across_clusters

Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a certain service or role.

kafka_bytes_fetched_15min_rate

Description
Amount of data consumers fetched from this topic on this broker: 15 Min Rate
Unit
bytes per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_fetched_1min_rate

Description
Amount of data consumers fetched from this topic on this broker: 1 Min Rate
Unit
bytes per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_fetched_5min_rate

Description
Amount of data consumers fetched from this topic on this broker: 5 Min Rate
Unit
bytes per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_fetched_avg_rate

Description
Amount of data consumers fetched from this topic on this broker: Avg Rate
Unit
bytes per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_fetched_rate

Description
Amount of data consumers fetched from this topic on this broker
Unit
bytes per second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_received_15min_rate

Description
Amount of data written to topic on this broker: 15 Min Rate
Unit
bytes per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_received_1min_rate

Description
Amount of data written to topic on this broker: 1 Min Rate
Unit
bytes per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_received_5min_rate

Description
Amount of data written to topic on this broker: 5 Min Rate
Unit
bytes per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_received_avg_rate

Description
Amount of data written to topic on this broker: Avg Rate
Unit
bytes per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_received_rate

Description
Amount of data written to topic on this broker
Unit
bytes per second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_rejected_15min_rate

Description
Amount of data in messages rejected by broker for this topic: 15 Min Rate
Unit
bytes per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_rejected_1min_rate

Description
Amount of data in messages rejected by broker for this topic: 1 Min Rate
Unit
bytes per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_rejected_5min_rate

Description
Amount of data in messages rejected by broker for this topic: 5 Min Rate
Unit
bytes per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_rejected_avg_rate

Description
Amount of data in messages rejected by broker for this topic: Avg Rate
Unit
bytes per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_bytes_rejected_rate

Description
Amount of data in messages rejected by broker for this topic
Unit
bytes per second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_fetch_request_failures_15min_rate

Description
Number of data read requests from consumers that brokers failed to process for this topic: 15 Min Rate
Unit
message.units.fetch_requests per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_fetch_request_failures_1min_rate

Description
Number of data read requests from consumers that brokers failed to process for this topic: 1 Min Rate
Unit
message.units.fetch_requests per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_fetch_request_failures_5min_rate

Description
Number of data read requests from consumers that brokers failed to process for this topic: 5 Min Rate
Unit
message.units.fetch_requests per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_fetch_request_failures_avg_rate

Description
Number of data read requests from consumers that brokers failed to process for this topic: Avg Rate
Unit
message.units.fetch_requests per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_fetch_request_failures_rate

Description
Number of data read requests from consumers that brokers failed to process for this topic
Unit
message.units.fetch_requests per second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_messages_received_15min_rate

Description
Number of messages written to topic on this broker: 15 Min Rate
Unit
messages per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_messages_received_1min_rate

Description
Number of messages written to topic on this broker: 1 Min Rate
Unit
messages per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_messages_received_5min_rate

Description
Number of messages written to topic on this broker: 5 Min Rate
Unit
messages per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_messages_received_avg_rate

Description
Number of messages written to topic on this broker: Avg Rate
Unit
messages per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_messages_received_rate

Description
Number of messages written to topic on this broker
Unit
messages per second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_rejected_message_batches_15min_rate

Description
Number of message batches sent by producers that the broker rejected for this topic: 15 Min Rate
Unit
message.units.message_batches per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_rejected_message_batches_1min_rate

Description
Number of message batches sent by producers that the broker rejected for this topic: 1 Min Rate
Unit
message.units.message_batches per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_rejected_message_batches_5min_rate

Description
Number of message batches sent by producers that the broker rejected for this topic: 5 Min Rate
Unit
message.units.message_batches per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_rejected_message_batches_avg_rate

Description
Number of message batches sent by producers that the broker rejected for this topic: Avg Rate
Unit
message.units.message_batches per message.units.singular.second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7

kafka_rejected_message_batches_rate

Description
Number of message batches sent by producers that the broker rejected for this topic
Unit
message.units.message_batches per second
Parents
cluster, kafka, kafka-kafka_broker, kafka_topic, rack
CDH Version
CDH 5, CDH 6, CDH 7