YARN Pool Metrics
In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.
In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.
Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".
For example, the following metric names may be valid for YARN Pool:
- active_applications_across_clusters
- total_active_applications_across_clusters
Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a certain service or role.
For more information about metrics, see Cloudera Manager Metrics and Metric Aggregation.
| Metric Name | Description | Unit | Parents | CDH Version |
|---|---|---|---|---|
| active_applications | Number of YARN applications in this pool with unsatisfied resource requests. | Applications | cluster, yarn | CDH 4, CDH 5 |
| active_applications_cumulative | Number of YARN applications in this pool with unsatisfied resource requests. Includes this pool and any children. | Applications | CDH 4, CDH 5 | |
| aggregate_containers_allocated_cumulative_rate | Aggregate Containers Allocated (Cumulative) | containers per second | CDH 4, CDH 5 | |
| aggregate_containers_allocated_rate | Aggregate Containers Allocated | containers per second | cluster, yarn | CDH 4, CDH 5 |
| aggregate_containers_released_cumulative_rate | Aggregate Containers Released (Cumulative) | containers per second | CDH 4, CDH 5 | |
| aggregate_containers_released_rate | Aggregate Containers Released | containers per second | cluster, yarn | CDH 4, CDH 5 |
| allocated_containers | Number of containers allocated in this pool. | containers | cluster, yarn | CDH 4, CDH 5 |
| allocated_containers_cumulative | Number of containers allocated in this pool. Includes this pool and its children. | containers | CDH 4, CDH 5 | |
| allocated_memory_mb | Allocated Memory | MB | cluster, yarn | CDH 4, CDH 5 |
| allocated_memory_mb_cumulative | Allocated Memory (Cumulative) | MB | CDH 4, CDH 5 | |
| allocated_vcores | Number of vcores allocated in this pool | VCores | cluster, yarn | CDH 4, CDH 5 |
| allocated_vcores_cumulative | Number of vcores allocated in this pool. Includes this pool and its children. | VCores | CDH 4, CDH 5 | |
| apps_completed_cumulative_rate | Number of completed YARN applications in this pool. Includes this pool and any children. | Applications per second | CDH 4, CDH 5 | |
| apps_completed_rate | Number of completed YARN applications in this pool. | Applications per second | cluster, yarn | CDH 4, CDH 5 |
| apps_failed_cumulative_rate | Number of failed YARN applications in this pool. Includes this pool and any children. | Applications per second | CDH 4, CDH 5 | |
| apps_failed_rate | Number of failed YARN applications in this pool. | Applications per second | cluster, yarn | CDH 4, CDH 5 |
| apps_ingested_rate | YARN applications ingested by the Service Monitor | Applications per second | cluster, yarn | CDH 4, CDH 5 |
| apps_killed_cumulative_rate | Number of killed YARN applications in this pool. Includes this pool and any children. | Applications per second | CDH 4, CDH 5 | |
| apps_killed_rate | Number of killed YARN applications in this pool. | Applications per second | cluster, yarn | CDH 4, CDH 5 |
| apps_pending | Number of pending (queued) YARN applications in this pool. | Applications | cluster, yarn | CDH 4, CDH 5 |
| apps_pending_cumulative | Number of pending (queued) YARN applications in this pool. Includes this pool and any children. | Applications | CDH 4, CDH 5 | |
| apps_running | Number of running YARN applications in this pool. | Applications | cluster, yarn | CDH 4, CDH 5 |
| apps_running_between_300to1440_mins | Number of running YARN applications in this pool for which elapsed time is between 300 and 1440 minutes. | Applications | cluster, yarn | CDH 4, CDH 5 |
| apps_running_between_300to1440_mins_cumulative | Number of running YARN applications in this pool for which elapsed time is between 300 and 1440 minutes. Includes this pool and any children. | Applications | CDH 4, CDH 5 | |
| apps_running_between_60to300_mins | Number of running YARN applications in this pool for which elapsed time is between 60 and 300 minutes. | Applications | cluster, yarn | CDH 4, CDH 5 |
| apps_running_between_60to300_mins_cumulative | Number of running YARN applications in this pool for which elapsed time is between 60 and 300 minutes. Includes this pool and any children. | Applications | CDH 4, CDH 5 | |
| apps_running_cumulative | Number of running YARN applications in this pool. Includes this pool and any children. | Applications | CDH 4, CDH 5 | |
| apps_running_over_1440_mins | Number of running YARN applications in this pool for which elapsed time is more than 1440 minutes. | Applications | cluster, yarn | CDH 4, CDH 5 |
| apps_running_over_1440_mins_cumulative | Number of running YARN applications in this pool for which elapsed time is more than 1440 minutes. Includes this pool and any children. | Applications | CDH 4, CDH 5 | |
| apps_running_within_60_mins | Number of running YARN applications in this pool for which elapsed time is less than 60 minutes. | Applications | cluster, yarn | CDH 4, CDH 5 |
| apps_running_within_60_mins_cumulative | Number of running YARN applications in this pool for which elapsed time is less than 60 minutes. Includes this pool and any children. | Applications | CDH 4, CDH 5 | |
| apps_submitted_cumulative_rate | Number of submitted YARN applications in this pool. Includes this pool and any children. | Applications per second | CDH 4, CDH 5 | |
| apps_submitted_rate | Number of submitted YARN applications in this queue. | Applications per second | cluster, yarn | CDH 4, CDH 5 |
| available_memory_mb | Memory not allocated to YARN containers. | MB | cluster, yarn | CDH 4, CDH 5 |
| available_vcores | Available vcores that can be used for containers. | VCores | cluster, yarn | CDH 4, CDH 5 |
| fair_share_mb | Fair share of memory in this pool. | MB | cluster, yarn | CDH 4, CDH 5 |
| fair_share_mb_cumulative | Fair share of memory in this pool. Includes this pool and its children. | MB | CDH 4, CDH 5 | |
| fair_share_vcores | Fair share of vcores in this pool. | VCores | cluster, yarn | CDH 4, CDH 5 |
| fair_share_vcores_cumulative | Fair share of vcores in this pool. Includes this pool and its children. | VCores | CDH 4, CDH 5 | |
| impala_query_bytes_streamed_rate | The total number of bytes sent between Impala Daemons while processing this query. Called 'bytes_streamed' in searches. | bytes per second | CDH 4, CDH 5 | |
| impala_query_cm_cpu_milliseconds_rate | impala.analysis.cm_cpu_milliseconds.description | ms per second | CDH 4, CDH 5 | |
| impala_query_hdfs_bytes_read_rate | The total number of bytes read from HDFS by this query. Called 'hdfs_bytes_read' in searches. | bytes per second | CDH 4, CDH 5 | |
| impala_query_hdfs_bytes_written_rate | The total number of bytes written to HDFS by this query. Called 'hdfs_bytes_written' in searches. | bytes per second | CDH 4, CDH 5 | |
| impala_query_query_duration_rate | The duration of the query in milliseconds. Called 'query_duration' in searches. | ms per second | CDH 4, CDH 5 | |
| impala_query_thread_cpu_time_rate | The sum of the CPU time used by all threads of the query. Called 'thread_cpu_time' in searches. | ms per second | CDH 4, CDH 5 | |
| max_share_mb | Maximum share of memory configured for this pool. | MB | cluster, yarn | CDH 4, CDH 5 |
| max_share_mb_cumulative | Maximum share of memory configured for this pool. Includes this pool and its children. | MB | CDH 4, CDH 5 | |
| max_share_vcores | Maximum share of vcores configured for this pool. | VCores | cluster, yarn | CDH 4, CDH 5 |
| max_share_vcores_cumulative | Maximum share of vcores configured for this pool. Includes this pool and its children. | VCores | CDH 4, CDH 5 | |
| min_share_mb | Minimum share of memory configured for this pool. | MB | cluster, yarn | CDH 4, CDH 5 |
| min_share_mb_cumulative | Minimum share of memory configured for this pool. Includes this pool and its children. | MB | CDH 4, CDH 5 | |
| min_share_vcores | Minimum share of vcores configured for this pool. | VCores | cluster, yarn | CDH 4, CDH 5 |
| min_share_vcores_cumulative | Minimum share of vcores configured for this pool. Includes this pool and its children. | VCores | CDH 4, CDH 5 | |
| pending_containers | Number of pending (queued) containers in this pool. | containers | cluster, yarn | CDH 4, CDH 5 |
| pending_containers_cumulative | Number of pending (queued) containers in this pool. Includes this pool and any children. | containers | CDH 4, CDH 5 | |
| pending_memory_mb | Sum of memory currently requested but not allocated for containers in this pool. | MB | cluster, yarn | CDH 4, CDH 5 |
| pending_memory_mb_cumulative | Sum of memory currently requested but not allocated for containers in this pool. Includes this pool and any children. | MB | CDH 4, CDH 5 | |
| pending_vcores | Number of vcores requested but not yet allocated for this pool. | VCores | cluster, yarn | CDH 4, CDH 5 |
| pending_vcores_cumulative | Number of vcores requested but not yet allocated for this pool. Includes this pool and its children. | VCores | CDH 4, CDH 5 | |
| queries_ingested_rate | Impala queries ingested by the Service Monitor | queries per second | cluster, yarn | CDH 4, CDH 5 |
| reserved_containers | Reserved containers for this pool. | containers | cluster, yarn | CDH 4, CDH 5 |
| reserved_containers_cumulative | Reserved containers for this pool. Includes this pool and any children. | containers | CDH 4, CDH 5 | |
| reserved_memory_mb | Reserved memory in this pool. | MB | cluster, yarn | CDH 4, CDH 5 |
| reserved_memory_mb_cumulative | Reserved memory in this pool. Includes this pool and any children. | MB | CDH 4, CDH 5 | |
| reserved_vcores | Number of vcores set aside for this pool, but not used as a part of an allocation. | VCores | cluster, yarn | CDH 4, CDH 5 |
| reserved_vcores_cumulative | Number of vcores set aside for this pool, but not used as a part of an allocation. Includes this pool and its children. | VCores | CDH 4, CDH 5 | |
| steady_fair_share_mb | Steady fair share of memory in this pool. | MB | cluster, yarn | CDH 4, CDH 5 |
| steady_fair_share_mb_cumulative | Steady fair share of memory in this pool. Includes this pool and its children. | MB | CDH 4, CDH 5 | |
| steady_fair_share_vcores | Steady fair share of vcores in this pool. | VCores | cluster, yarn | CDH 4, CDH 5 |
| steady_fair_share_vcores_cumulative | Steady fair share of vcores in this pool. Includes this pool and its children. | VCores | CDH 4, CDH 5 | |
| yarn_application_application_duration_rate | How long YARN took to execute this application. Called 'application_duration' in searches. | ms per second | CDH 4, CDH 5 | |
| yarn_application_cm_cpu_milliseconds_rate | yarn.analysis.cm_cpu_milliseconds.description | ms per second | CDH 4, CDH 5 | |
| yarn_application_cpu_milliseconds_rate | CPU time. Called 'cpu_milliseconds' in searches. | ms per second | CDH 4, CDH 5 | |
| yarn_application_file_bytes_read_rate | File bytes read. Called 'file_bytes_read' in searches. | bytes per second | CDH 4, CDH 5 | |
| yarn_application_file_bytes_written_rate | File bytes written. Called 'file_bytes_written' in searches. | bytes per second | CDH 4, CDH 5 | |
| yarn_application_hdfs_bytes_read_rate | HDFS bytes read. Called 'hdfs_bytes_read' in searches. | bytes per second | CDH 4, CDH 5 | |
| yarn_application_hdfs_bytes_written_rate | HDFS bytes written. Called 'hdfs_bytes_written' in searches. | bytes per second | CDH 4, CDH 5 | |
| yarn_application_maps_rate | The number of Map tasks in this MapReduce job. Called 'maps_total' in searches. | items per second | CDH 4, CDH 5 | |
| yarn_application_mb_millis_maps_rate | Map memory allocation. Called 'mb_millis_maps' in searches. | items per second | CDH 4, CDH 5 | |
| yarn_application_mb_millis_reduces_rate | Reduce memory allocation. Called 'mb_millis_reduces' in searches. | items per second | CDH 4, CDH 5 | |
| yarn_application_reduces_rate | The number of reduce tasks in this MapReduce job. Called 'reduces_total' in searches. | items per second | CDH 4, CDH 5 | |
| yarn_application_vcores_millis_maps_rate | Map CPU allocation. Called 'vcores_millis_maps' in searches. | items per second | CDH 4, CDH 5 | |
| yarn_application_vcores_millis_reduces_rate | Reduce CPU allocation. Called 'vcores_millis_reduces' in searches. | items per second | CDH 4, CDH 5 |