YARN Pool Metrics
In addition to these base metrics, many aggregate metrics are available.
If an entity type has parents defined, you can formulate all possible
aggregate metrics using the formula
base_metric_across_parents.
In addition, metrics for aggregate totals can be formed by adding the prefix
total_ to the front of the metric name.
Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".
For example, the following metric names may be valid for YARN Pool:
-
active_applications_across_clusters -
total_active_applications_across_clusters
Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a
certain service or role.
| Metric Name | Description | Unit | Parents | CDH Version |
|---|---|---|---|---|
| active_applications | Number of YARN applications in this pool with unsatisfied resource requests. | Applications | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| active_applications_cumulative | Number of YARN applications in this pool with unsatisfied resource requests. Includes this pool and any children. | Applications | CDH 5, CDH 6, CDH 7 | |
| aggregate_containers_allocated_cumulative_rate | Aggregate Containers Allocated (Cumulative) | containers per second | CDH 5, CDH 6, CDH 7 | |
| aggregate_containers_allocated_rate | Aggregate Containers Allocated | containers per second | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| aggregate_containers_released_cumulative_rate | Aggregate Containers Released (Cumulative) | containers per second | CDH 5, CDH 6, CDH 7 | |
| aggregate_containers_released_rate | Aggregate Containers Released | containers per second | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| allocated_containers | Number of containers allocated in this pool. | containers | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| allocated_containers_cumulative | Number of containers allocated in this pool. Includes this pool and its children. | containers | CDH 5, CDH 6, CDH 7 | |
| allocated_memory_mb | Allocated Memory | MB | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| allocated_memory_mb_cumulative | Allocated Memory (Cumulative) | MB | CDH 5, CDH 6, CDH 7 | |
| allocated_memory_mb_with_pending_containers | Allocated memory when pending containers is more than zero. | MB | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| allocated_vcores | Number of vcores allocated in this pool | VCores | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| allocated_vcores_cumulative | Number of vcores allocated in this pool. Includes this pool and its children. | VCores | CDH 5, CDH 6, CDH 7 | |
| allocated_vcores_with_pending_containers | Allocated vcores when pending containers is more than zero. | VCores | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| apps_completed_cumulative_rate | Number of completed YARN applications in this pool. Includes this pool and any children. | Applications per second | CDH 5, CDH 6, CDH 7 | |
| apps_completed_rate | Number of completed YARN applications in this pool. | Applications per second | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| apps_failed_cumulative_rate | Number of failed YARN applications in this pool. Includes this pool and any children. | Applications per second | CDH 5, CDH 6, CDH 7 | |
| apps_failed_rate | Number of failed YARN applications in this pool. | Applications per second | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| apps_ingested_rate | YARN applications ingested by the Service Monitor | Applications per second | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| apps_killed_cumulative_rate | Number of killed YARN applications in this pool. Includes this pool and any children. | Applications per second | CDH 5, CDH 6, CDH 7 | |
| apps_killed_rate | Number of killed YARN applications in this pool. | Applications per second | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| apps_pending | Number of pending (queued) YARN applications in this pool. | Applications | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| apps_pending_cumulative | Number of pending (queued) YARN applications in this pool. Includes this pool and any children. | Applications | CDH 5, CDH 6, CDH 7 | |
| apps_running | Number of running YARN applications in this pool. | Applications | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| apps_running_between_300to1440_mins | Number of running YARN applications in this pool for which elapsed time is between 300 and 1440 minutes. | Applications | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| apps_running_between_300to1440_mins_cumulative | Number of running YARN applications in this pool for which elapsed time is between 300 and 1440 minutes. Includes this pool and any children. | Applications | CDH 5, CDH 6, CDH 7 | |
| apps_running_between_60to300_mins | Number of running YARN applications in this pool for which elapsed time is between 60 and 300 minutes. | Applications | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| apps_running_between_60to300_mins_cumulative | Number of running YARN applications in this pool for which elapsed time is between 60 and 300 minutes. Includes this pool and any children. | Applications | CDH 5, CDH 6, CDH 7 | |
| apps_running_cumulative | Number of running YARN applications in this pool. Includes this pool and any children. | Applications | CDH 5, CDH 6, CDH 7 | |
| apps_running_over_1440_mins | Number of running YARN applications in this pool for which elapsed time is more than 1440 minutes. | Applications | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| apps_running_over_1440_mins_cumulative | Number of running YARN applications in this pool for which elapsed time is more than 1440 minutes. Includes this pool and any children. | Applications | CDH 5, CDH 6, CDH 7 | |
| apps_running_within_60_mins | Number of running YARN applications in this pool for which elapsed time is less than 60 minutes. | Applications | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| apps_running_within_60_mins_cumulative | Number of running YARN applications in this pool for which elapsed time is less than 60 minutes. Includes this pool and any children. | Applications | CDH 5, CDH 6, CDH 7 | |
| apps_submitted_cumulative_rate | Number of submitted YARN applications in this pool. Includes this pool and any children. | Applications per second | CDH 5, CDH 6, CDH 7 | |
| apps_submitted_rate | Number of submitted YARN applications in this queue. | Applications per second | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| available_memory_mb | Memory not allocated to YARN containers. | MB | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| available_vcores | Available vcores that can be used for containers. | VCores | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| container_wait_ratio | Percent of pending containers when pending containers is more than zero. | percent | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| fair_share_mb | Fair share of memory in this pool. | MB | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| fair_share_mb_cumulative | Fair share of memory in this pool. Includes this pool and its children. | MB | CDH 5, CDH 6, CDH 7 | |
| fair_share_mb_with_pending_containers | Fair share of memory when pending containers is more than zero. | MB | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| fair_share_vcores | Fair share of vcores in this pool. | VCores | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| fair_share_vcores_cumulative | Fair share of vcores in this pool. Includes this pool and its children. | VCores | CDH 5, CDH 6, CDH 7 | |
| fair_share_vcores_with_pending_containers | Fair share of vcores when pending containers is more than zero. | VCores | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| max_share_mb | Maximum share of memory configured for this pool. | MB | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| max_share_mb_cumulative | Maximum share of memory configured for this pool. Includes this pool and its children. | MB | CDH 5, CDH 6, CDH 7 | |
| max_share_vcores | Maximum share of vcores configured for this pool. | VCores | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| max_share_vcores_cumulative | Maximum share of vcores configured for this pool. Includes this pool and its children. | VCores | CDH 5, CDH 6, CDH 7 | |
| min_share_mb | Minimum share of memory configured for this pool. | MB | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| min_share_mb_cumulative | Minimum share of memory configured for this pool. Includes this pool and its children. | MB | CDH 5, CDH 6, CDH 7 | |
| min_share_vcores | Minimum share of vcores configured for this pool. | VCores | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| min_share_vcores_cumulative | Minimum share of vcores configured for this pool. Includes this pool and its children. | VCores | CDH 5, CDH 6, CDH 7 | |
| pending_containers | Number of pending (queued) containers in this pool. | containers | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| pending_containers_cumulative | Number of pending (queued) containers in this pool. Includes this pool and any children. | containers | CDH 5, CDH 6, CDH 7 | |
| pending_memory_mb | Sum of memory currently requested but not allocated for containers in this pool. | MB | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| pending_memory_mb_cumulative | Sum of memory currently requested but not allocated for containers in this pool. Includes this pool and any children. | MB | CDH 5, CDH 6, CDH 7 | |
| pending_vcores | Number of vcores requested but not yet allocated for this pool. | VCores | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| pending_vcores_cumulative | Number of vcores requested but not yet allocated for this pool. Includes this pool and its children. | VCores | CDH 5, CDH 6, CDH 7 | |
| queries_ingested_rate | Impala queries ingested by the Service Monitor | queries per second | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| reserved_containers | Reserved containers for this pool. | containers | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| reserved_containers_cumulative | Reserved containers for this pool. Includes this pool and any children. | containers | CDH 5, CDH 6, CDH 7 | |
| reserved_memory_mb | Reserved memory in this pool. | MB | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| reserved_memory_mb_cumulative | Reserved memory in this pool. Includes this pool and any children. | MB | CDH 5, CDH 6, CDH 7 | |
| reserved_vcores | Number of vcores set aside for this pool, but not used as a part of an allocation. | VCores | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| reserved_vcores_cumulative | Number of vcores set aside for this pool, but not used as a part of an allocation. Includes this pool and its children. | VCores | CDH 5, CDH 6, CDH 7 | |
| steady_fair_share_mb | Steady fair share of memory in this pool. | MB | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| steady_fair_share_mb_cumulative | Steady fair share of memory in this pool. Includes this pool and its children. | MB | CDH 5, CDH 6, CDH 7 | |
| steady_fair_share_mb_with_pending_containers | Steady fair share of memory when pending containers is more than zero. | MB | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| steady_fair_share_vcores | Steady fair share of vcores in this pool. | VCores | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| steady_fair_share_vcores_cumulative | Steady fair share of vcores in this pool. Includes this pool and its children. | VCores | CDH 5, CDH 6, CDH 7 | |
| steady_fair_share_vcores_with_pending_containers | Steady fair share of vcores when pending containers is more than zero. | VCores | cluster, yarn | CDH 5, CDH 6, CDH 7 |
| yarn_application_adl_bytes_read_rate | ADL bytes read. Called 'adl_bytes_read' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_adl_bytes_written_rate | ADL bytes written. Called 'adl_bytes_written' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_application_duration_rate | How long YARN took to execute this application. Called 'application_duration' in searches. | ms per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_cm_cpu_milliseconds_rate | yarn.analysis.cm_cpu_milliseconds.description | ms per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_cpu_milliseconds_rate | CPU time. Called 'cpu_milliseconds' in searches. | ms per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_file_bytes_read_rate | File bytes read. Called 'file_bytes_read' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_file_bytes_written_rate | File bytes written. Called 'file_bytes_written' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_hdfs_bytes_read_rate | HDFS bytes read. Called 'hdfs_bytes_read' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_hdfs_bytes_written_rate | HDFS bytes written. Called 'hdfs_bytes_written' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_maps_rate | The number of Map tasks in this MapReduce job. Called 'maps_total' in searches. | items per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_mb_millis_maps_rate | Map memory allocation. Called 'mb_millis_maps' in searches. | items per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_mb_millis_reduces_rate | Reduce memory allocation. Called 'mb_millis_reduces' in searches. | items per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_reduces_rate | The number of reduce tasks in this MapReduce job. Called 'reduces_total' in searches. | items per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_s3a_bytes_read_rate | S3A bytes read. Called 's3a_bytes_read' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_s3a_bytes_written_rate | S3A bytes written. Called 's3a_bytes_written' in searches. | bytes per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_vcores_millis_maps_rate | Map CPU allocation. Called 'vcores_millis_maps' in searches. | items per second | CDH 5, CDH 6, CDH 7 | |
| yarn_application_vcores_millis_reduces_rate | Reduce CPU allocation. Called 'vcores_millis_reduces' in searches. | items per second | CDH 5, CDH 6, CDH 7 | |
| absolute_used_capacity | Absolute used capacity for the pool | percent | cluster, yarn | CDH 6, CDH 7 |
| guaranteed_mb | Guaranteed memory for the pool | MB | cluster, yarn | CDH 6, CDH 7 |
| guaranteed_vcores | Guaranteed vcores for the pool | VCores | cluster, yarn | CDH 6, CDH 7 |
| max_capacity_mb | Maximum memory capacity for the pool | MB | cluster, yarn | CDH 6, CDH 7 |
| max_capacity_vcores | Maximum vcores capacity for the pool | VCores | cluster, yarn | CDH 6, CDH 7 |
| used_capacity | Used capacity for the pool | percent | cluster, yarn | CDH 7 |
