Apache Ambari Operations
Also available as:
PDF
loading table of contents...
Kafka - Home

Metrics that show overall status for the Kafka cluster.

Row

Metrics

Description

BYTES IN & OUT / MESSAGES IN

Bytes In & Bytes Out /secRate at which bytes are produced into the Kafka cluster and the rate at which bytes are being consumed from the Kafka cluster.
Messages In /secNumber of messages produced into the Kafka cluster.

CONTROLLER/LEADER COUNT & REPLICA MAXLAG

Active Controller Count

Number of active controllers in the Kafka cluster. This should always equal one.

Replica MaxLag

Shows the lag of each replica from the leader.

Leader CountNumber of partitions for which a particular host is the leader.

UNDER REPLICATED PATRITIONS & OFFLINE PARTITONS COUNT

Under Replicated PartitionsIndicates if any partitions in the cluster are under-replicated.
Offline Partitions Count

Indicates if any partitions are offline (which means that no leaders or replicas are available for producing or consuming).

PRODUCER & CONSUMER REQUESTSProducer Req /secRate at which producer requests are made to the Kafka cluster.
Consumer Req /sec

Rate at which consumer requests are made from the Kafka cluster.

LEADER ELECTION AND UNCLEAN LEADER ELECTIONSLeader Election Rate

Rate at which leader election is happening in the Kafka cluster.

Unclean Leader ElectionsIndicates if there are any unclean leader elections. Unclean leader election indicates that a replica which is not part of ISR is elected as a leader.
ISR SHRINKS / ISR EXPANDEDIsrShrinksPerSecIf the broker goes down, ISR shrinks. In such case, this metric indicates if any of the partitions are not part of ISR.
IsrExpandsPerSecOnce the broker comes back up and catches up with the leader, this metric indicates if any partitions rejoined ISR.
REPLICA FETCHER MANAGERReplicaFetcherManager MaxLagThe maximum lag in messages between the follower and leader replicas.