Kafka Connect Connector Source Task Metrics Metrics

Reference information for Kafka Connect Connector Source Task Metrics Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

For example, the following metric names may be valid for Kafka Connect Connector Source Task Metrics:

  • kafka_connect_connector_source_task_metrics_poll_batch_avg_time_ms_across_clusters
  • total_kafka_connect_connector_source_task_metrics_poll_batch_avg_time_ms_across_clusters

Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a certain service or role.

kafka_connect_connector_source_task_metrics_poll_batch_avg_time_ms

Description
The average time in milliseconds taken by this task to poll for a batch of source records.
Unit
message.units.milliseconds
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_source_task_metrics_poll_batch_max_time_ms

Description
The maximum time in milliseconds taken by this task to poll for a batch of source records
Unit
message.units.milliseconds
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_source_task_metrics_source_record_active_count

Description
The most recent number of records that have been produced by this task but not yet completely written to Kafka.
Unit
records
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_source_task_metrics_source_record_active_count_avg

Description
The average number of records that have been produced by this task but not yet completely written to Kafka.
Unit
records
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_source_task_metrics_source_record_active_count_max

Description
The maximum number of records that have been produced by this task but not yet completely written to Kafka.
Unit
records
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_source_task_metrics_source_record_poll_rate

Description
The average per-second number of records produced/polled (before transformation) by this task belonging to the named source connector in this worker.
Unit
records per second
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_source_task_metrics_source_record_poll_total

Description
The number of records produced/polled (before transformation) by this task belonging to the named source connector in this worker, since the task was last restarted.
Unit
records
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_source_task_metrics_source_record_write_rate

Description
The average per-second number of records output from the transformations and written to Kafka for this task belonging to the named source connector in this worker. This is after transformations are applied and excludes any records filtered out by the transformations
Unit
records per second
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_source_task_metrics_source_record_write_total

Description
The number of records output from the transformations and written to Kafka for this task belonging to the named source connector in this worker, since the task was last restarted.
Unit
records
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)