Metrics ReferencePDF version

User Metrics

Reference information for User Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

Description
YARN applications ingested by the Service Monitor
Unit
Applications per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
The time from submission for admission to its completion. Called 'admission_wait' in searches.
Unit
ms per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
The total number of bytes sent between Impala Daemons while processing this query. Called 'bytes_streamed' in searches.
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
impala.analysis.cm_cpu_milliseconds.description
Unit
ms per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
The total number of bytes read from HDFS by this query. Called 'hdfs_bytes_read' in searches.
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
The total number of bytes written to HDFS by this query. Called 'hdfs_bytes_written' in searches.
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
The total accrued memory usage by the query. This is computed by multiplying the average aggregate memory usage of the query by the query's duration. Called 'memory_accrual' in searches.
Unit
byte seconds per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
Amount of memory spilled to disk. Called 'memory_spilled' in searches.
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
The duration of the query in milliseconds. Called 'query_duration' in searches.
Unit
ms per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
The sum of the CPU time used by all threads of the query. Called 'thread_cpu_time' in searches.
Unit
ms per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
Impala queries ingested by the Service Monitor
Unit
queries per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
Impala queries for which memory consumption exceeded what was allowed
Unit
queries per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
Impala queries rejected from admission, commonly due to the queue being full or insufficient memory
Unit
queries per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
Impala queries that spilled to disk
Unit
queries per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
Impala queries that ran to completion successfully
Unit
queries per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
Impala queries that timed out waiting in queue during admission
Unit
queries per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
ADL bytes read. Called 'adl_bytes_read' in searches.
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
ADL bytes written. Called 'adl_bytes_written' in searches.
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
How long YARN took to execute this application. Called 'application_duration' in searches.
Unit
ms per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
yarn.analysis.cm_cpu_milliseconds.description
Unit
ms per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
CPU time. Called 'cpu_milliseconds' in searches.
Unit
ms per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
File bytes read. Called 'file_bytes_read' in searches.
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
File bytes written. Called 'file_bytes_written' in searches.
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
HDFS bytes read. Called 'hdfs_bytes_read' in searches.
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
HDFS bytes written. Called 'hdfs_bytes_written' in searches.
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
The number of Map tasks in this MapReduce job. Called 'maps_total' in searches.
Unit
items per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
Map memory allocation. Called 'mb_millis_maps' in searches.
Unit
items per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
Reduce memory allocation. Called 'mb_millis_reduces' in searches.
Unit
items per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
The number of reduce tasks in this MapReduce job. Called 'reduces_total' in searches.
Unit
items per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
S3A bytes read. Called 's3a_bytes_read' in searches.
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
S3A bytes written. Called 's3a_bytes_written' in searches.
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
Map CPU allocation. Called 'vcores_millis_maps' in searches.
Unit
items per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
Description
Reduce CPU allocation. Called 'vcores_millis_reduces' in searches.
Unit
items per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)