Kafka Connect Connector Sink Task Metrics Metrics

Reference information for Kafka Connect Connector Sink Task Metrics Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

For example, the following metric names may be valid for Kafka Connect Connector Sink Task Metrics:

  • kafka_connect_connector_sink_task_metrics_partition_count_across_clusters
  • total_kafka_connect_connector_sink_task_metrics_partition_count_across_clusters

Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a certain service or role.

kafka_connect_connector_sink_task_metrics_partition_count

Description
The number of topic partitions assigned to this task belonging to the named sink connector in this worker.
Unit
message.units.connectors
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_sink_task_metrics_put_batch_avg_time_ms

Description
The average time taken by this task to put a batch of sinks records.
Unit
message.units.milliseconds
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_sink_task_metrics_sink_record_lag_max

Description
The maximum lag in terms of number of records that the sink task is behind the consumer's position for any topic partitions.
Unit
message.units.connectors
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)

kafka_connect_connector_sink_task_metrics_sink_record_send_rate

Description
The average per-second number of records output from the transformations and sent/put to this task belonging to the named sink connector in this worker. This is after transformations are applied and excludes any records filtered out by the transformations.
Unit
message.units.connectors per second
Parents
cluster, kafka, kafka-kafka_connect, rack
CDH Version
[CDH 5.0.0..CDH 8.0.0)