YARN Pool User Metrics
In addition to these base metrics, many aggregate metrics are available.
If an entity type has parents defined, you can formulate all possible
aggregate metrics using the formula
base_metric_across_parents
.
In addition, metrics for aggregate totals can be formed by adding the prefix
total_
to the front of the metric name.
Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".
For example, the following metric names may be valid for YARN Pool User:
-
apps_ingested_rate_across_clusters
-
total_apps_ingested_rate_across_clusters
Some metrics, such as alerts_rate
, apply to nearly every metric context. Others only apply to a
certain service or role.
Metric Name | Description | Unit | Parents | CDH Version |
---|---|---|---|---|
apps_ingested_rate | YARN applications ingested by the Service Monitor | Applications per second | cluster, yarn, yarn_pool | CDH 5, CDH 6, CDH 7 |
yarn_application_adl_bytes_read_rate | ADL bytes read. Called 'adl_bytes_read' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_adl_bytes_written_rate | ADL bytes written. Called 'adl_bytes_written' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_application_duration_rate | How long YARN took to execute this application. Called 'application_duration' in searches. | ms per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_cm_cpu_milliseconds_rate | yarn.analysis.cm_cpu_milliseconds.description | ms per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_cpu_milliseconds_rate | CPU time. Called 'cpu_milliseconds' in searches. | ms per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_file_bytes_read_rate | File bytes read. Called 'file_bytes_read' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_file_bytes_written_rate | File bytes written. Called 'file_bytes_written' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_hdfs_bytes_read_rate | HDFS bytes read. Called 'hdfs_bytes_read' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_hdfs_bytes_written_rate | HDFS bytes written. Called 'hdfs_bytes_written' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_maps_rate | The number of Map tasks in this MapReduce job. Called 'maps_total' in searches. | items per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_mb_millis_maps_rate | Map memory allocation. Called 'mb_millis_maps' in searches. | items per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_mb_millis_reduces_rate | Reduce memory allocation. Called 'mb_millis_reduces' in searches. | items per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_reduces_rate | The number of reduce tasks in this MapReduce job. Called 'reduces_total' in searches. | items per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_s3a_bytes_read_rate | S3A bytes read. Called 's3a_bytes_read' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_s3a_bytes_written_rate | S3A bytes written. Called 's3a_bytes_written' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_vcores_millis_maps_rate | Map CPU allocation. Called 'vcores_millis_maps' in searches. | items per second | CDH 5, CDH 6, CDH 7 | |
yarn_application_vcores_millis_reduces_rate | Reduce CPU allocation. Called 'vcores_millis_reduces' in searches. | items per second | CDH 5, CDH 6, CDH 7 | |
yarn_reports_containers_allocated_memory | Memory allocated to YARN containers | MB seconds | cluster, yarn, yarn_pool | CDH 5, CDH 6, CDH 7 |
yarn_reports_containers_allocated_vcores | VCores allocated to YARN containers | VCore seconds | cluster, yarn, yarn_pool | CDH 5, CDH 6, CDH 7 |
yarn_reports_containers_used_cpu | CPU used by YARN containers | Percent seconds | cluster, yarn, yarn_pool | CDH 5, CDH 6, CDH 7 |
yarn_reports_containers_used_memory | Memory used by YARN containers | MB seconds | cluster, yarn, yarn_pool | CDH 5, CDH 6, CDH 7 |
yarn_reports_containers_used_vcores | VCores used by YARN containers | VCore seconds | cluster, yarn, yarn_pool | CDH 5, CDH 6, CDH 7 |