Cloudera Manager Metrics Reference

Kafka Broker Topic Partition Metrics

Reference information for Kafka Broker Topic Partition Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

For example, the following metric names may be valid for Kafka Broker Topic Partition:

kafka_bytes_fetched_by_partition_15min_rate_across_clusters
total_kafka_bytes_fetched_by_partition_15min_rate_across_clusters

Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a certain service or role.

kafka_bytes_fetched_by_partition_15min_rate🔗

Description: Amount of data consumers fetched from this topic partition on this broker: 15 Min Rate
Unit: bytes per message.units.singular.second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_bytes_fetched_by_partition_1min_rate🔗

Description: Amount of data consumers fetched from this topic partition on this broker: 1 Min Rate
Unit: bytes per message.units.singular.second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_bytes_fetched_by_partition_5min_rate🔗

Description: Amount of data consumers fetched from this topic partition on this broker: 5 Min Rate
Unit: bytes per message.units.singular.second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_bytes_fetched_by_partition_avg_rate🔗

Description: Amount of data consumers fetched from this topic partition on this broker: Avg Rate
Unit: bytes per message.units.singular.second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_bytes_fetched_by_partition_rate🔗

Description: Amount of data consumers fetched from this topic partition on this broker
Unit: bytes per second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_bytes_received_by_partition_15min_rate🔗

Description: Amount of data written to topic partition on this broker: 15 Min Rate
Unit: bytes per message.units.singular.second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_bytes_received_by_partition_1min_rate🔗

Description: Amount of data written to topic partition on this broker: 1 Min Rate
Unit: bytes per message.units.singular.second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_bytes_received_by_partition_5min_rate🔗

Description: Amount of data written to topic partition on this broker: 5 Min Rate
Unit: bytes per message.units.singular.second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_bytes_received_by_partition_avg_rate🔗

Description: Amount of data written to topic partition on this broker: Avg Rate
Unit: bytes per message.units.singular.second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_bytes_received_by_partition_rate🔗

Description: Amount of data written to topic partition on this broker
Unit: bytes per second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_messages_received_by_partition_15min_rate🔗

Description: Number of messages written to topic partition on this broker: 15 Min Rate
Unit: messages per message.units.singular.second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_messages_received_by_partition_1min_rate🔗

Description: Number of messages written to topic partition on this broker: 1 Min Rate
Unit: messages per message.units.singular.second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_messages_received_by_partition_5min_rate🔗

Description: Number of messages written to topic partition on this broker: 5 Min Rate
Unit: messages per message.units.singular.second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_messages_received_by_partition_avg_rate🔗

Description: Number of messages written to topic partition on this broker: Avg Rate
Unit: messages per message.units.singular.second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)

kafka_messages_received_by_partition_rate🔗

Description: Number of messages written to topic partition on this broker
Unit: messages per second
Parents: cluster, kafka, kafka-kafka_broker, kafka_broker_topic, kafka_topic, rack
CDH Version: [CDH 5.0.0..CDH 8.0.0)