User Metrics
Reference information for User Metrics
In addition to these base metrics, many aggregate metrics are available.
If an entity type has parents defined, you can formulate all possible
aggregate metrics using the formula
base_metric_across_parents.
In addition, metrics for aggregate totals can be formed by adding the prefix
total_ to the front of the metric name.
Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".
apps_ingested_rate
- Description
- YARN applications ingested by the Service Monitor
- Unit
- Applications per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
impala_query_admission_wait_rate
- Description
- The time from submission for admission to its completion. Called 'admission_wait' in searches.
- Unit
- ms per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
impala_query_bytes_streamed_rate
- Description
- The total number of bytes sent between Impala Daemons while processing this query. Called 'bytes_streamed' in searches.
- Unit
- bytes per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
impala_query_cm_cpu_milliseconds_rate
- Description
- impala.analysis.cm_cpu_milliseconds.description
- Unit
- ms per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
impala_query_hdfs_bytes_read_rate
- Description
- The total number of bytes read from HDFS by this query. Called 'hdfs_bytes_read' in searches.
- Unit
- bytes per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
impala_query_hdfs_bytes_written_rate
- Description
- The total number of bytes written to HDFS by this query. Called 'hdfs_bytes_written' in searches.
- Unit
- bytes per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
impala_query_memory_accrual_rate
- Description
- The total accrued memory usage by the query. This is computed by multiplying the average aggregate memory usage of the query by the query's duration. Called 'memory_accrual' in searches.
- Unit
- byte seconds per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
impala_query_memory_spilled_rate
- Description
- Amount of memory spilled to disk. Called 'memory_spilled' in searches.
- Unit
- bytes per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
impala_query_query_duration_rate
- Description
- The duration of the query in milliseconds. Called 'query_duration' in searches.
- Unit
- ms per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
impala_query_thread_cpu_time_rate
- Description
- The sum of the CPU time used by all threads of the query. Called 'thread_cpu_time' in searches.
- Unit
- ms per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
queries_ingested_rate
- Description
- Impala queries ingested by the Service Monitor
- Unit
- queries per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
queries_oom_rate
- Description
- Impala queries for which memory consumption exceeded what was allowed
- Unit
- queries per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
queries_rejected_rate
- Description
- Impala queries rejected from admission, commonly due to the queue being full or insufficient memory
- Unit
- queries per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
queries_spilled_memory_rate
- Description
- Impala queries that spilled to disk
- Unit
- queries per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
queries_successful_rate
- Description
- Impala queries that ran to completion successfully
- Unit
- queries per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
queries_timed_out_rate
- Description
- Impala queries that timed out waiting in queue during admission
- Unit
- queries per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_adl_bytes_read_rate
- Description
- ADL bytes read. Called 'adl_bytes_read' in searches.
- Unit
- bytes per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_adl_bytes_written_rate
- Description
- ADL bytes written. Called 'adl_bytes_written' in searches.
- Unit
- bytes per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_application_duration_rate
- Description
- How long YARN took to execute this application. Called 'application_duration' in searches.
- Unit
- ms per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_cm_cpu_milliseconds_rate
- Description
- yarn.analysis.cm_cpu_milliseconds.description
- Unit
- ms per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_cpu_milliseconds_rate
- Description
- CPU time. Called 'cpu_milliseconds' in searches.
- Unit
- ms per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_file_bytes_read_rate
- Description
- File bytes read. Called 'file_bytes_read' in searches.
- Unit
- bytes per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_file_bytes_written_rate
- Description
- File bytes written. Called 'file_bytes_written' in searches.
- Unit
- bytes per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_hdfs_bytes_read_rate
- Description
- HDFS bytes read. Called 'hdfs_bytes_read' in searches.
- Unit
- bytes per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_hdfs_bytes_written_rate
- Description
- HDFS bytes written. Called 'hdfs_bytes_written' in searches.
- Unit
- bytes per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_maps_rate
- Description
- The number of Map tasks in this MapReduce job. Called 'maps_total' in searches.
- Unit
- items per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_mb_millis_maps_rate
- Description
- Map memory allocation. Called 'mb_millis_maps' in searches.
- Unit
- items per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_mb_millis_reduces_rate
- Description
- Reduce memory allocation. Called 'mb_millis_reduces' in searches.
- Unit
- items per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_reduces_rate
- Description
- The number of reduce tasks in this MapReduce job. Called 'reduces_total' in searches.
- Unit
- items per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_s3a_bytes_read_rate
- Description
- S3A bytes read. Called 's3a_bytes_read' in searches.
- Unit
- bytes per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_s3a_bytes_written_rate
- Description
- S3A bytes written. Called 's3a_bytes_written' in searches.
- Unit
- bytes per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_vcores_millis_maps_rate
- Description
- Map CPU allocation. Called 'vcores_millis_maps' in searches.
- Unit
- items per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
yarn_application_vcores_millis_reduces_rate
- Description
- Reduce CPU allocation. Called 'vcores_millis_reduces' in searches.
- Unit
- items per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
