Kafka Connect Connector Task Metrics Metrics

Reference information for Kafka Connect Connector Task Metrics Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

For example, the following metric names may be valid for Kafka Connect Connector Task Metrics:

  • kafka_connect_connector_task_metrics_batch_size_avg_across_clusters
  • total_kafka_connect_connector_task_metrics_batch_size_avg_across_clusters

Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a certain service or role.

kafka_connect_connector_task_metrics_batch_size_avg

Description
The average size of the batches processed by the connector.
Unit
message.units.connectors
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_task_metrics_batch_size_max

Description
The maximum size of the batches processed by the connector.
Unit
batches
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_task_metrics_offset_commit_avg_time_ms

Description
The average time in milliseconds taken by this task to commit offsets.
Unit
message.units.milliseconds
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_task_metrics_offset_commit_failure_percentage

Description
The average percentage of this task's offset commit attempts that failed or had an error.
Unit
message.units.failure
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_task_metrics_offset_commit_max_time_ms

Description
The maximum time in milliseconds taken by this task to commit offsets.
Unit
message.units.milliseconds
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_task_metrics_offset_commit_success_percentage

Description
The average percentage of this task's offset commit attempts that succeeded.
Unit
message.units.success
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_task_metrics_pause_ratio

Description
The fraction of time this task has spent in the paused state.
Unit
message.units.pause_ratio
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_task_metrics_running_ratio

Description
The fraction of time this task has spent in the running state.
Unit
message.units.running_ratio
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)