Kafka Broker Topic Metrics
In addition to these base metrics, many aggregate metrics are available.
If an entity type has parents defined, you can formulate all possible
aggregate metrics using the formula
base_metric_across_parents.
In addition, metrics for aggregate totals can be formed by adding the prefix
total_ to the front of the metric name.
Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".
For example, the following metric names may be valid for Kafka Broker Topic:
-
kafka_bytes_fetched_15min_rate_across_clusters -
total_kafka_bytes_fetched_15min_rate_across_clusters
Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a
certain service or role.
For more information about metrics, see Cloudera Manager Metrics and Metric Aggregation.
| Metric Name | Description | Unit | Parents | CDH Version |
|---|---|---|---|---|
| kafka_bytes_fetched_15min_rate | Amount of data consumers fetched from this topic on this broker: 15 Min Rate | bytes per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_fetched_1min_rate | Amount of data consumers fetched from this topic on this broker: 1 Min Rate | bytes per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_fetched_5min_rate | Amount of data consumers fetched from this topic on this broker: 5 Min Rate | bytes per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_fetched_avg_rate | Amount of data consumers fetched from this topic on this broker: Avg Rate | bytes per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_fetched_rate | Amount of data consumers fetched from this topic on this broker | bytes per second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_received_15min_rate | Amount of data written to topic on this broker: 15 Min Rate | bytes per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_received_1min_rate | Amount of data written to topic on this broker: 1 Min Rate | bytes per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_received_5min_rate | Amount of data written to topic on this broker: 5 Min Rate | bytes per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_received_avg_rate | Amount of data written to topic on this broker: Avg Rate | bytes per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_received_rate | Amount of data written to topic on this broker | bytes per second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_rejected_15min_rate | Amount of data in messages rejected by broker for this topic: 15 Min Rate | bytes per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_rejected_1min_rate | Amount of data in messages rejected by broker for this topic: 1 Min Rate | bytes per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_rejected_5min_rate | Amount of data in messages rejected by broker for this topic: 5 Min Rate | bytes per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_rejected_avg_rate | Amount of data in messages rejected by broker for this topic: Avg Rate | bytes per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_bytes_rejected_rate | Amount of data in messages rejected by broker for this topic | bytes per second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_fetch_request_failures_15min_rate | Number of data read requests from consumers that brokers failed to process for this topic: 15 Min Rate | message.units.fetch_requests per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_fetch_request_failures_1min_rate | Number of data read requests from consumers that brokers failed to process for this topic: 1 Min Rate | message.units.fetch_requests per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_fetch_request_failures_5min_rate | Number of data read requests from consumers that brokers failed to process for this topic: 5 Min Rate | message.units.fetch_requests per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_fetch_request_failures_avg_rate | Number of data read requests from consumers that brokers failed to process for this topic: Avg Rate | message.units.fetch_requests per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_fetch_request_failures_rate | Number of data read requests from consumers that brokers failed to process for this topic | message.units.fetch_requests per second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_messages_received_15min_rate | Number of messages written to topic on this broker: 15 Min Rate | messages per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_messages_received_1min_rate | Number of messages written to topic on this broker: 1 Min Rate | messages per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_messages_received_5min_rate | Number of messages written to topic on this broker: 5 Min Rate | messages per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_messages_received_avg_rate | Number of messages written to topic on this broker: Avg Rate | messages per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_messages_received_rate | Number of messages written to topic on this broker | messages per second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_rejected_message_batches_15min_rate | Number of message batches sent by producers that the broker rejected for this topic: 15 Min Rate | message.units.message_batches per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_rejected_message_batches_1min_rate | Number of message batches sent by producers that the broker rejected for this topic: 1 Min Rate | message.units.message_batches per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_rejected_message_batches_5min_rate | Number of message batches sent by producers that the broker rejected for this topic: 5 Min Rate | message.units.message_batches per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_rejected_message_batches_avg_rate | Number of message batches sent by producers that the broker rejected for this topic: Avg Rate | message.units.message_batches per message.units.singular.second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
| kafka_rejected_message_batches_rate | Number of message batches sent by producers that the broker rejected for this topic | message.units.message_batches per second | cluster, kafka, kafka-kafka_broker, kafka_topic, rack | CDH 5, CDH 6, CDH 7 |
