YARN Pool Metrics

Reference information for YARN Pool Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

For example, the following metric names may be valid for YARN Pool:

  • active_applications_across_clusters
  • total_active_applications_across_clusters

Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a certain service or role.

active_applications

Description
Number of YARN applications in this pool with unsatisfied resource requests.
Unit
Applications
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

active_applications_cumulative

Description
Number of YARN applications in this pool with unsatisfied resource requests. Includes this pool and any children.
Unit
Applications
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

aggregate_containers_allocated_cumulative_rate

Description
Aggregate Containers Allocated (Cumulative)
Unit
containers per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

aggregate_containers_allocated_rate

Description
Aggregate Containers Allocated
Unit
containers per second
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

aggregate_containers_released_cumulative_rate

Description
Aggregate Containers Released (Cumulative)
Unit
containers per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

aggregate_containers_released_rate

Description
Aggregate Containers Released
Unit
containers per second
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

allocated_containers

Description
Number of containers allocated in this pool.
Unit
containers
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

allocated_containers_cumulative

Description
Number of containers allocated in this pool. Includes this pool and its children.
Unit
containers
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

allocated_memory_mb

Description
Allocated Memory
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

allocated_memory_mb_cumulative

Description
Allocated Memory (Cumulative)
Unit
MB
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

allocated_memory_mb_with_pending_containers

Description
Allocated memory when pending containers is more than zero.
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

allocated_vcores

Description
Number of vcores allocated in this pool
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

allocated_vcores_cumulative

Description
Number of vcores allocated in this pool. Includes this pool and its children.
Unit
VCores
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

allocated_vcores_with_pending_containers

Description
Allocated vcores when pending containers is more than zero.
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_completed_cumulative_rate

Description
Number of completed YARN applications in this pool. Includes this pool and any children.
Unit
Applications per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_completed_rate

Description
Number of completed YARN applications in this pool.
Unit
Applications per second
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_failed_cumulative_rate

Description
Number of failed YARN applications in this pool. Includes this pool and any children.
Unit
Applications per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_failed_rate

Description
Number of failed YARN applications in this pool.
Unit
Applications per second
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_ingested_rate

Description
YARN applications ingested by the Service Monitor
Unit
Applications per second
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_killed_cumulative_rate

Description
Number of killed YARN applications in this pool. Includes this pool and any children.
Unit
Applications per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_killed_rate

Description
Number of killed YARN applications in this pool.
Unit
Applications per second
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_pending

Description
Number of pending (queued) YARN applications in this pool.
Unit
Applications
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_pending_cumulative

Description
Number of pending (queued) YARN applications in this pool. Includes this pool and any children.
Unit
Applications
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_running

Description
Number of running YARN applications in this pool.
Unit
Applications
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_running_between_300to1440_mins

Description
Number of running YARN applications in this pool for which elapsed time is between 300 and 1440 minutes.
Unit
Applications
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_running_between_300to1440_mins_cumulative

Description
Number of running YARN applications in this pool for which elapsed time is between 300 and 1440 minutes. Includes this pool and any children.
Unit
Applications
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_running_between_60to300_mins

Description
Number of running YARN applications in this pool for which elapsed time is between 60 and 300 minutes.
Unit
Applications
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_running_between_60to300_mins_cumulative

Description
Number of running YARN applications in this pool for which elapsed time is between 60 and 300 minutes. Includes this pool and any children.
Unit
Applications
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_running_cumulative

Description
Number of running YARN applications in this pool. Includes this pool and any children.
Unit
Applications
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_running_over_1440_mins

Description
Number of running YARN applications in this pool for which elapsed time is more than 1440 minutes.
Unit
Applications
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_running_over_1440_mins_cumulative

Description
Number of running YARN applications in this pool for which elapsed time is more than 1440 minutes. Includes this pool and any children.
Unit
Applications
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_running_within_60_mins

Description
Number of running YARN applications in this pool for which elapsed time is less than 60 minutes.
Unit
Applications
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_running_within_60_mins_cumulative

Description
Number of running YARN applications in this pool for which elapsed time is less than 60 minutes. Includes this pool and any children.
Unit
Applications
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_submitted_cumulative_rate

Description
Number of submitted YARN applications in this pool. Includes this pool and any children.
Unit
Applications per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

apps_submitted_rate

Description
Number of submitted YARN applications in this queue.
Unit
Applications per second
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

available_memory_mb

Description
Memory not allocated to YARN containers.
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

available_vcores

Description
Available vcores that can be used for containers.
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

container_wait_ratio

Description
Percent of pending containers when pending containers is more than zero.
Unit
percent
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

fair_share_mb

Description
Fair share of memory in this pool.
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

fair_share_mb_cumulative

Description
Fair share of memory in this pool. Includes this pool and its children.
Unit
MB
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

fair_share_mb_with_pending_containers

Description
Fair share of memory when pending containers is more than zero.
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

fair_share_vcores

Description
Fair share of vcores in this pool.
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

fair_share_vcores_cumulative

Description
Fair share of vcores in this pool. Includes this pool and its children.
Unit
VCores
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

fair_share_vcores_with_pending_containers

Description
Fair share of vcores when pending containers is more than zero.
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

max_share_mb

Description
Maximum share of memory configured for this pool.
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

max_share_mb_cumulative

Description
Maximum share of memory configured for this pool. Includes this pool and its children.
Unit
MB
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

max_share_vcores

Description
Maximum share of vcores configured for this pool.
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

max_share_vcores_cumulative

Description
Maximum share of vcores configured for this pool. Includes this pool and its children.
Unit
VCores
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

min_share_mb

Description
Minimum share of memory configured for this pool.
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

min_share_mb_cumulative

Description
Minimum share of memory configured for this pool. Includes this pool and its children.
Unit
MB
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

min_share_vcores

Description
Minimum share of vcores configured for this pool.
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

min_share_vcores_cumulative

Description
Minimum share of vcores configured for this pool. Includes this pool and its children.
Unit
VCores
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

pending_containers

Description
Number of pending (queued) containers in this pool.
Unit
containers
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

pending_containers_cumulative

Description
Number of pending (queued) containers in this pool. Includes this pool and any children.
Unit
containers
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

pending_memory_mb

Description
Sum of memory currently requested but not allocated for containers in this pool.
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

pending_memory_mb_cumulative

Description
Sum of memory currently requested but not allocated for containers in this pool. Includes this pool and any children.
Unit
MB
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

pending_vcores

Description
Number of vcores requested but not yet allocated for this pool.
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

pending_vcores_cumulative

Description
Number of vcores requested but not yet allocated for this pool. Includes this pool and its children.
Unit
VCores
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

queries_ingested_rate

Description
Impala queries ingested by the Service Monitor
Unit
queries per second
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

reserved_containers

Description
Reserved containers for this pool.
Unit
containers
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

reserved_containers_cumulative

Description
Reserved containers for this pool. Includes this pool and any children.
Unit
containers
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

reserved_memory_mb

Description
Reserved memory in this pool.
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

reserved_memory_mb_cumulative

Description
Reserved memory in this pool. Includes this pool and any children.
Unit
MB
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

reserved_vcores

Description
Number of vcores set aside for this pool, but not used as a part of an allocation.
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

reserved_vcores_cumulative

Description
Number of vcores set aside for this pool, but not used as a part of an allocation. Includes this pool and its children.
Unit
VCores
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

steady_fair_share_mb

Description
Steady fair share of memory in this pool.
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

steady_fair_share_mb_cumulative

Description
Steady fair share of memory in this pool. Includes this pool and its children.
Unit
MB
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

steady_fair_share_mb_with_pending_containers

Description
Steady fair share of memory when pending containers is more than zero.
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

steady_fair_share_vcores

Description
Steady fair share of vcores in this pool.
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

steady_fair_share_vcores_cumulative

Description
Steady fair share of vcores in this pool. Includes this pool and its children.
Unit
VCores
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

steady_fair_share_vcores_with_pending_containers

Description
Steady fair share of vcores when pending containers is more than zero.
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

absolute_used_capacity

Description
Absolute used capacity for the pool
Unit
percent
Parents
cluster, yarn
CDH Version
[CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

guaranteed_mb

Description
Guaranteed memory for the pool
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

guaranteed_vcores

Description
Guaranteed vcores for the pool
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

max_capacity_mb

Description
Maximum memory capacity for the pool
Unit
MB
Parents
cluster, yarn
CDH Version
[CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

max_capacity_vcores

Description
Maximum vcores capacity for the pool
Unit
VCores
Parents
cluster, yarn
CDH Version
[CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)

used_capacity

Description
Used capacity for the pool
Unit
percent
Parents
cluster, yarn
CDH Version
[CDH 7.0.0..CDH 8.0.0)