YARN Pool Metrics
Reference information for YARN Pool Metrics
In addition to these base metrics, many aggregate metrics are available.
If an entity type has parents defined, you can formulate all possible
aggregate metrics using the formula
base_metric_across_parents.
In addition, metrics for aggregate totals can be formed by adding the prefix
total_ to the front of the metric name.
Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".
For example, the following metric names may be valid for YARN Pool:
-
active_applications_across_clusters -
total_active_applications_across_clusters
Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a
certain service or role.
active_applications
- Description
- Number of YARN applications in this pool with unsatisfied resource requests.
- Unit
- Applications
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
active_applications_cumulative
- Description
- Number of YARN applications in this pool with unsatisfied resource requests. Includes this pool and any children.
- Unit
- Applications
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
aggregate_containers_allocated_cumulative_rate
- Description
- Aggregate Containers Allocated (Cumulative)
- Unit
- containers per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
aggregate_containers_allocated_rate
- Description
- Aggregate Containers Allocated
- Unit
- containers per second
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
aggregate_containers_released_cumulative_rate
- Description
- Aggregate Containers Released (Cumulative)
- Unit
- containers per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
aggregate_containers_released_rate
- Description
- Aggregate Containers Released
- Unit
- containers per second
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
allocated_containers
- Description
- Number of containers allocated in this pool.
- Unit
- containers
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
allocated_containers_cumulative
- Description
- Number of containers allocated in this pool. Includes this pool and its children.
- Unit
- containers
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
allocated_memory_mb
- Description
- Allocated Memory
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
allocated_memory_mb_cumulative
- Description
- Allocated Memory (Cumulative)
- Unit
- MB
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
allocated_memory_mb_with_pending_containers
- Description
- Allocated memory when pending containers is more than zero.
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
allocated_vcores
- Description
- Number of vcores allocated in this pool
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
allocated_vcores_cumulative
- Description
- Number of vcores allocated in this pool. Includes this pool and its children.
- Unit
- VCores
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
allocated_vcores_with_pending_containers
- Description
- Allocated vcores when pending containers is more than zero.
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_completed_cumulative_rate
- Description
- Number of completed YARN applications in this pool. Includes this pool and any children.
- Unit
- Applications per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_completed_rate
- Description
- Number of completed YARN applications in this pool.
- Unit
- Applications per second
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_failed_cumulative_rate
- Description
- Number of failed YARN applications in this pool. Includes this pool and any children.
- Unit
- Applications per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_failed_rate
- Description
- Number of failed YARN applications in this pool.
- Unit
- Applications per second
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_ingested_rate
- Description
- YARN applications ingested by the Service Monitor
- Unit
- Applications per second
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_killed_cumulative_rate
- Description
- Number of killed YARN applications in this pool. Includes this pool and any children.
- Unit
- Applications per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_killed_rate
- Description
- Number of killed YARN applications in this pool.
- Unit
- Applications per second
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_pending
- Description
- Number of pending (queued) YARN applications in this pool.
- Unit
- Applications
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_pending_cumulative
- Description
- Number of pending (queued) YARN applications in this pool. Includes this pool and any children.
- Unit
- Applications
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_running
- Description
- Number of running YARN applications in this pool.
- Unit
- Applications
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_running_between_300to1440_mins
- Description
- Number of running YARN applications in this pool for which elapsed time is between 300 and 1440 minutes.
- Unit
- Applications
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_running_between_300to1440_mins_cumulative
- Description
- Number of running YARN applications in this pool for which elapsed time is between 300 and 1440 minutes. Includes this pool and any children.
- Unit
- Applications
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_running_between_60to300_mins
- Description
- Number of running YARN applications in this pool for which elapsed time is between 60 and 300 minutes.
- Unit
- Applications
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_running_between_60to300_mins_cumulative
- Description
- Number of running YARN applications in this pool for which elapsed time is between 60 and 300 minutes. Includes this pool and any children.
- Unit
- Applications
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_running_cumulative
- Description
- Number of running YARN applications in this pool. Includes this pool and any children.
- Unit
- Applications
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_running_over_1440_mins
- Description
- Number of running YARN applications in this pool for which elapsed time is more than 1440 minutes.
- Unit
- Applications
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_running_over_1440_mins_cumulative
- Description
- Number of running YARN applications in this pool for which elapsed time is more than 1440 minutes. Includes this pool and any children.
- Unit
- Applications
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_running_within_60_mins
- Description
- Number of running YARN applications in this pool for which elapsed time is less than 60 minutes.
- Unit
- Applications
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_running_within_60_mins_cumulative
- Description
- Number of running YARN applications in this pool for which elapsed time is less than 60 minutes. Includes this pool and any children.
- Unit
- Applications
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_submitted_cumulative_rate
- Description
- Number of submitted YARN applications in this pool. Includes this pool and any children.
- Unit
- Applications per second
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
apps_submitted_rate
- Description
- Number of submitted YARN applications in this queue.
- Unit
- Applications per second
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
available_memory_mb
- Description
- Memory not allocated to YARN containers.
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
available_vcores
- Description
- Available vcores that can be used for containers.
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
container_wait_ratio
- Description
- Percent of pending containers when pending containers is more than zero.
- Unit
- percent
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
fair_share_mb
- Description
- Fair share of memory in this pool.
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
fair_share_mb_cumulative
- Description
- Fair share of memory in this pool. Includes this pool and its children.
- Unit
- MB
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
fair_share_mb_with_pending_containers
- Description
- Fair share of memory when pending containers is more than zero.
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
fair_share_vcores
- Description
- Fair share of vcores in this pool.
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
fair_share_vcores_cumulative
- Description
- Fair share of vcores in this pool. Includes this pool and its children.
- Unit
- VCores
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
fair_share_vcores_with_pending_containers
- Description
- Fair share of vcores when pending containers is more than zero.
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
max_share_mb
- Description
- Maximum share of memory configured for this pool.
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
max_share_mb_cumulative
- Description
- Maximum share of memory configured for this pool. Includes this pool and its children.
- Unit
- MB
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
max_share_vcores
- Description
- Maximum share of vcores configured for this pool.
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
max_share_vcores_cumulative
- Description
- Maximum share of vcores configured for this pool. Includes this pool and its children.
- Unit
- VCores
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
min_share_mb
- Description
- Minimum share of memory configured for this pool.
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
min_share_mb_cumulative
- Description
- Minimum share of memory configured for this pool. Includes this pool and its children.
- Unit
- MB
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
min_share_vcores
- Description
- Minimum share of vcores configured for this pool.
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
min_share_vcores_cumulative
- Description
- Minimum share of vcores configured for this pool. Includes this pool and its children.
- Unit
- VCores
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
pending_containers
- Description
- Number of pending (queued) containers in this pool.
- Unit
- containers
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
pending_containers_cumulative
- Description
- Number of pending (queued) containers in this pool. Includes this pool and any children.
- Unit
- containers
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
pending_memory_mb
- Description
- Sum of memory currently requested but not allocated for containers in this pool.
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
pending_memory_mb_cumulative
- Description
- Sum of memory currently requested but not allocated for containers in this pool. Includes this pool and any children.
- Unit
- MB
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
pending_vcores
- Description
- Number of vcores requested but not yet allocated for this pool.
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
pending_vcores_cumulative
- Description
- Number of vcores requested but not yet allocated for this pool. Includes this pool and its children.
- Unit
- VCores
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
queries_ingested_rate
- Description
- Impala queries ingested by the Service Monitor
- Unit
- queries per second
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
reserved_containers
- Description
- Reserved containers for this pool.
- Unit
- containers
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
reserved_containers_cumulative
- Description
- Reserved containers for this pool. Includes this pool and any children.
- Unit
- containers
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
reserved_memory_mb
- Description
- Reserved memory in this pool.
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
reserved_memory_mb_cumulative
- Description
- Reserved memory in this pool. Includes this pool and any children.
- Unit
- MB
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
reserved_vcores
- Description
- Number of vcores set aside for this pool, but not used as a part of an allocation.
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
reserved_vcores_cumulative
- Description
- Number of vcores set aside for this pool, but not used as a part of an allocation. Includes this pool and its children.
- Unit
- VCores
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
steady_fair_share_mb
- Description
- Steady fair share of memory in this pool.
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
steady_fair_share_mb_cumulative
- Description
- Steady fair share of memory in this pool. Includes this pool and its children.
- Unit
- MB
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
steady_fair_share_mb_with_pending_containers
- Description
- Steady fair share of memory when pending containers is more than zero.
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
steady_fair_share_vcores
- Description
- Steady fair share of vcores in this pool.
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
steady_fair_share_vcores_cumulative
- Description
- Steady fair share of vcores in this pool. Includes this pool and its children.
- Unit
- VCores
- Parents
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
steady_fair_share_vcores_with_pending_containers
- Description
- Steady fair share of vcores when pending containers is more than zero.
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
absolute_used_capacity
- Description
- Absolute used capacity for the pool
- Unit
- percent
- Parents
- cluster, yarn
- CDH Version
- [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
guaranteed_mb
- Description
- Guaranteed memory for the pool
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
guaranteed_vcores
- Description
- Guaranteed vcores for the pool
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
max_capacity_mb
- Description
- Maximum memory capacity for the pool
- Unit
- MB
- Parents
- cluster, yarn
- CDH Version
- [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
max_capacity_vcores
- Description
- Maximum vcores capacity for the pool
- Unit
- VCores
- Parents
- cluster, yarn
- CDH Version
- [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0)
used_capacity
- Description
- Used capacity for the pool
- Unit
- percent
- Parents
- cluster, yarn
- CDH Version
- [CDH 7.0.0..CDH 8.0.0)
