YARN Pool Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

For example, the following metric names may be valid for YARN Pool:

  • active_applications_across_clusters
  • total_active_applications_across_clusters

Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a certain service or role.

For more information about metrics, see Cloudera Manager Metrics and Metric Aggregation.

Metric Name Description Unit Parents CDH Version
active_applications Number of YARN applications in this pool with unsatisfied resource requests. Applications cluster, yarn CDH 5, CDH 6
active_applications_cumulative Number of YARN applications in this pool with unsatisfied resource requests. Includes this pool and any children. Applications   CDH 5, CDH 6
aggregate_containers_allocated_cumulative_rate Aggregate Containers Allocated (Cumulative) containers per second   CDH 5, CDH 6
aggregate_containers_allocated_rate Aggregate Containers Allocated containers per second cluster, yarn CDH 5, CDH 6
aggregate_containers_released_cumulative_rate Aggregate Containers Released (Cumulative) containers per second   CDH 5, CDH 6
aggregate_containers_released_rate Aggregate Containers Released containers per second cluster, yarn CDH 5, CDH 6
allocated_containers Number of containers allocated in this pool. containers cluster, yarn CDH 5, CDH 6
allocated_containers_cumulative Number of containers allocated in this pool. Includes this pool and its children. containers   CDH 5, CDH 6
allocated_memory_mb Allocated Memory MB cluster, yarn CDH 5, CDH 6
allocated_memory_mb_cumulative Allocated Memory (Cumulative) MB   CDH 5, CDH 6
allocated_memory_mb_with_pending_containers Allocated memory when pending containers is more than zero. MB cluster, yarn CDH 5, CDH 6
allocated_vcores Number of vcores allocated in this pool VCores cluster, yarn CDH 5, CDH 6
allocated_vcores_cumulative Number of vcores allocated in this pool. Includes this pool and its children. VCores   CDH 5, CDH 6
allocated_vcores_with_pending_containers Allocated vcores when pending containers is more than zero. VCores cluster, yarn CDH 5, CDH 6
apps_completed_cumulative_rate Number of completed YARN applications in this pool. Includes this pool and any children. Applications per second   CDH 5, CDH 6
apps_completed_rate Number of completed YARN applications in this pool. Applications per second cluster, yarn CDH 5, CDH 6
apps_failed_cumulative_rate Number of failed YARN applications in this pool. Includes this pool and any children. Applications per second   CDH 5, CDH 6
apps_failed_rate Number of failed YARN applications in this pool. Applications per second cluster, yarn CDH 5, CDH 6
apps_ingested_rate YARN applications ingested by the Service Monitor Applications per second cluster, yarn CDH 5, CDH 6
apps_killed_cumulative_rate Number of killed YARN applications in this pool. Includes this pool and any children. Applications per second   CDH 5, CDH 6
apps_killed_rate Number of killed YARN applications in this pool. Applications per second cluster, yarn CDH 5, CDH 6
apps_pending Number of pending (queued) YARN applications in this pool. Applications cluster, yarn CDH 5, CDH 6
apps_pending_cumulative Number of pending (queued) YARN applications in this pool. Includes this pool and any children. Applications   CDH 5, CDH 6
apps_running Number of running YARN applications in this pool. Applications cluster, yarn CDH 5, CDH 6
apps_running_between_300to1440_mins Number of running YARN applications in this pool for which elapsed time is between 300 and 1440 minutes. Applications cluster, yarn CDH 5, CDH 6
apps_running_between_300to1440_mins_cumulative Number of running YARN applications in this pool for which elapsed time is between 300 and 1440 minutes. Includes this pool and any children. Applications   CDH 5, CDH 6
apps_running_between_60to300_mins Number of running YARN applications in this pool for which elapsed time is between 60 and 300 minutes. Applications cluster, yarn CDH 5, CDH 6
apps_running_between_60to300_mins_cumulative Number of running YARN applications in this pool for which elapsed time is between 60 and 300 minutes. Includes this pool and any children. Applications   CDH 5, CDH 6
apps_running_cumulative Number of running YARN applications in this pool. Includes this pool and any children. Applications   CDH 5, CDH 6
apps_running_over_1440_mins Number of running YARN applications in this pool for which elapsed time is more than 1440 minutes. Applications cluster, yarn CDH 5, CDH 6
apps_running_over_1440_mins_cumulative Number of running YARN applications in this pool for which elapsed time is more than 1440 minutes. Includes this pool and any children. Applications   CDH 5, CDH 6
apps_running_within_60_mins Number of running YARN applications in this pool for which elapsed time is less than 60 minutes. Applications cluster, yarn CDH 5, CDH 6
apps_running_within_60_mins_cumulative Number of running YARN applications in this pool for which elapsed time is less than 60 minutes. Includes this pool and any children. Applications   CDH 5, CDH 6
apps_submitted_cumulative_rate Number of submitted YARN applications in this pool. Includes this pool and any children. Applications per second   CDH 5, CDH 6
apps_submitted_rate Number of submitted YARN applications in this queue. Applications per second cluster, yarn CDH 5, CDH 6
available_memory_mb Memory not allocated to YARN containers. MB cluster, yarn CDH 5, CDH 6
available_vcores Available vcores that can be used for containers. VCores cluster, yarn CDH 5, CDH 6
container_wait_ratio Percent of pending containers when pending containers is more than zero. percent cluster, yarn CDH 5, CDH 6
fair_share_mb Fair share of memory in this pool. MB cluster, yarn CDH 5, CDH 6
fair_share_mb_cumulative Fair share of memory in this pool. Includes this pool and its children. MB   CDH 5, CDH 6
fair_share_mb_with_pending_containers Fair share of memory when pending containers is more than zero. MB cluster, yarn CDH 5, CDH 6
fair_share_vcores Fair share of vcores in this pool. VCores cluster, yarn CDH 5, CDH 6
fair_share_vcores_cumulative Fair share of vcores in this pool. Includes this pool and its children. VCores   CDH 5, CDH 6
fair_share_vcores_with_pending_containers Fair share of vcores when pending containers is more than zero. VCores cluster, yarn CDH 5, CDH 6
max_share_mb Maximum share of memory configured for this pool. MB cluster, yarn CDH 5, CDH 6
max_share_mb_cumulative Maximum share of memory configured for this pool. Includes this pool and its children. MB   CDH 5, CDH 6
max_share_vcores Maximum share of vcores configured for this pool. VCores cluster, yarn CDH 5, CDH 6
max_share_vcores_cumulative Maximum share of vcores configured for this pool. Includes this pool and its children. VCores   CDH 5, CDH 6
min_share_mb Minimum share of memory configured for this pool. MB cluster, yarn CDH 5, CDH 6
min_share_mb_cumulative Minimum share of memory configured for this pool. Includes this pool and its children. MB   CDH 5, CDH 6
min_share_vcores Minimum share of vcores configured for this pool. VCores cluster, yarn CDH 5, CDH 6
min_share_vcores_cumulative Minimum share of vcores configured for this pool. Includes this pool and its children. VCores   CDH 5, CDH 6
pending_containers Number of pending (queued) containers in this pool. containers cluster, yarn CDH 5, CDH 6
pending_containers_cumulative Number of pending (queued) containers in this pool. Includes this pool and any children. containers   CDH 5, CDH 6
pending_memory_mb Sum of memory currently requested but not allocated for containers in this pool. MB cluster, yarn CDH 5, CDH 6
pending_memory_mb_cumulative Sum of memory currently requested but not allocated for containers in this pool. Includes this pool and any children. MB   CDH 5, CDH 6
pending_vcores Number of vcores requested but not yet allocated for this pool. VCores cluster, yarn CDH 5, CDH 6
pending_vcores_cumulative Number of vcores requested but not yet allocated for this pool. Includes this pool and its children. VCores   CDH 5, CDH 6
queries_ingested_rate Impala queries ingested by the Service Monitor queries per second cluster, yarn CDH 5, CDH 6
reserved_containers Reserved containers for this pool. containers cluster, yarn CDH 5, CDH 6
reserved_containers_cumulative Reserved containers for this pool. Includes this pool and any children. containers   CDH 5, CDH 6
reserved_memory_mb Reserved memory in this pool. MB cluster, yarn CDH 5, CDH 6
reserved_memory_mb_cumulative Reserved memory in this pool. Includes this pool and any children. MB   CDH 5, CDH 6
reserved_vcores Number of vcores set aside for this pool, but not used as a part of an allocation. VCores cluster, yarn CDH 5, CDH 6
reserved_vcores_cumulative Number of vcores set aside for this pool, but not used as a part of an allocation. Includes this pool and its children. VCores   CDH 5, CDH 6
steady_fair_share_mb Steady fair share of memory in this pool. MB cluster, yarn CDH 5, CDH 6
steady_fair_share_mb_cumulative Steady fair share of memory in this pool. Includes this pool and its children. MB   CDH 5, CDH 6
steady_fair_share_mb_with_pending_containers Steady fair share of memory when pending containers is more than zero. MB cluster, yarn CDH 5, CDH 6
steady_fair_share_vcores Steady fair share of vcores in this pool. VCores cluster, yarn CDH 5, CDH 6
steady_fair_share_vcores_cumulative Steady fair share of vcores in this pool. Includes this pool and its children. VCores   CDH 5, CDH 6
steady_fair_share_vcores_with_pending_containers Steady fair share of vcores when pending containers is more than zero. VCores cluster, yarn CDH 5, CDH 6
yarn_application_adl_bytes_read_rate ADL bytes read. Called 'adl_bytes_read' in searches. bytes per second   CDH 5, CDH 6
yarn_application_adl_bytes_written_rate ADL bytes written. Called 'adl_bytes_written' in searches. bytes per second   CDH 5, CDH 6
yarn_application_application_duration_rate How long YARN took to execute this application. Called 'application_duration' in searches. ms per second   CDH 5, CDH 6
yarn_application_cm_cpu_milliseconds_rate yarn.analysis.cm_cpu_milliseconds.description ms per second   CDH 5, CDH 6
yarn_application_cpu_milliseconds_rate CPU time. Called 'cpu_milliseconds' in searches. ms per second   CDH 5, CDH 6
yarn_application_file_bytes_read_rate File bytes read. Called 'file_bytes_read' in searches. bytes per second   CDH 5, CDH 6
yarn_application_file_bytes_written_rate File bytes written. Called 'file_bytes_written' in searches. bytes per second   CDH 5, CDH 6
yarn_application_hdfs_bytes_read_rate HDFS bytes read. Called 'hdfs_bytes_read' in searches. bytes per second   CDH 5, CDH 6
yarn_application_hdfs_bytes_written_rate HDFS bytes written. Called 'hdfs_bytes_written' in searches. bytes per second   CDH 5, CDH 6
yarn_application_maps_rate The number of Map tasks in this MapReduce job. Called 'maps_total' in searches. items per second   CDH 5, CDH 6
yarn_application_mb_millis_maps_rate Map memory allocation. Called 'mb_millis_maps' in searches. items per second   CDH 5, CDH 6
yarn_application_mb_millis_reduces_rate Reduce memory allocation. Called 'mb_millis_reduces' in searches. items per second   CDH 5, CDH 6
yarn_application_reduces_rate The number of reduce tasks in this MapReduce job. Called 'reduces_total' in searches. items per second   CDH 5, CDH 6
yarn_application_s3a_bytes_read_rate S3A bytes read. Called 's3a_bytes_read' in searches. bytes per second   CDH 5, CDH 6
yarn_application_s3a_bytes_written_rate S3A bytes written. Called 's3a_bytes_written' in searches. bytes per second   CDH 5, CDH 6
yarn_application_vcores_millis_maps_rate Map CPU allocation. Called 'vcores_millis_maps' in searches. items per second   CDH 5, CDH 6
yarn_application_vcores_millis_reduces_rate Reduce CPU allocation. Called 'vcores_millis_reduces' in searches. items per second   CDH 5, CDH 6