JobTracker Metrics

Reference information for JobTracker Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

For example, the following metric names may be valid for JobTracker:

  • alerts_rate_across_clusters
  • total_alerts_rate_across_clusters

Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a certain service or role.

alerts_rate

Description
The number of alerts.
Unit
events per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

blacklisted_maps_rate

Description
Blacklisted Maps
Unit
tasks per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

blacklisted_reduces_rate

Description
Blacklisted Reduces
Unit
tasks per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

cgroup_cpu_system_rate

Description
CPU usage of the role's cgroup
Unit
seconds per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

cgroup_cpu_user_rate

Description
User Space CPU usage of the role's cgroup
Unit
seconds per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

cgroup_mem_page_cache

Description
Page cache usage of the role's cgroup
Unit
bytes
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

cgroup_mem_rss

Description
Resident memory of the role's cgroup
Unit
bytes
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

cgroup_mem_swap

Description
Swap usage of the role's cgroup
Unit
bytes
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

cgroup_read_bytes_rate

Description
Bytes read from all disks by the role's cgroup
Unit
bytes per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

cgroup_read_ios_rate

Description
Number of read I/O operations from all disks by the role's cgroup
Unit
ios per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

cgroup_write_bytes_rate

Description
Bytes written to all disks by the role's cgroup
Unit
bytes per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

cgroup_write_ios_rate

Description
Number of write I/O operations to all disks by the role's cgroup
Unit
ios per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

cpu_system_rate

Description
Total System CPU
Unit
seconds per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

cpu_user_rate

Description
Total CPU user time
Unit
seconds per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

events_critical_rate

Description
The number of critical events.
Unit
events per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

events_important_rate

Description
The number of important events.
Unit
events per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

events_informational_rate

Description
The number of informational events.
Unit
events per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

fd_max

Description
Maximum number of file descriptors
Unit
file descriptors
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

fd_open

Description
Open file descriptors.
Unit
file descriptors
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

health_bad_rate

Description
Percentage of Time with Bad Health
Unit
seconds per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

health_concerning_rate

Description
Percentage of Time with Concerning Health
Unit
seconds per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

health_disabled_rate

Description
Percentage of Time with Disabled Health
Unit
seconds per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

health_good_rate

Description
Percentage of Time with Good Health
Unit
seconds per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

health_unknown_rate

Description
Percentage of Time with Unknown Health
Unit
seconds per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

heartbeats_rate

Description
Heartbeats
Unit
operations per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jobs_completed_rate

Description
Jobs Completed
Unit
jobs per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jobs_failed_rate

Description
Jobs Failed
Unit
jobs per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jobs_killed_rate

Description
Jobs Killed
Unit
jobs per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jobs_preparing

Description
Jobs Preparing
Unit
jobs
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jobs_running

Description
Jobs Running
Unit
jobs
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jobs_submitted_rate

Description
Jobs Submitted
Unit
jobs per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_blocked_threads

Description
Blocked threads
Unit
threads
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_gc_rate

Description
Number of garbage collections
Unit
garbage collections per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_gc_time_ms_rate

Description
Total time spent garbage collecting.
Unit
ms per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_heap_committed_mb

Description
Total amount of committed heap memory.
Unit
MB
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_heap_used_mb

Description
Total amount of used heap memory.
Unit
MB
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_max_memory_mb

Description
Maximum allowed memory.
Unit
MB
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_new_threads

Description
New threads
Unit
threads
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_non_heap_committed_mb

Description
Total amount of committed non-heap memory.
Unit
MB
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_non_heap_used_mb

Description
Total amount of used non-heap memory.
Unit
MB
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_runnable_threads

Description
Runnable threads
Unit
threads
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_terminated_threads

Description
Terminated threads
Unit
threads
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_timed_waiting_threads

Description
Timed waiting threads
Unit
threads
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_total_threads

Description
Total threads
Unit
threads
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

jvm_waiting_threads

Description
Waiting threads
Unit
threads
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

log_error_rate

Description
Logged Errors
Unit
messages per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

log_fatal_rate

Description
Logged Fatals
Unit
messages per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

log_info_rate

Description
Logged Infos
Unit
messages per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

log_warn_rate

Description
Logged Warnings
Unit
messages per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

map_slots

Description
Map Slots
Unit
slots
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

maps_completed_rate

Description
Maps Completed
Unit
tasks per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

maps_failed_rate

Description
Maps Failed
Unit
tasks per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

maps_killed_rate

Description
Maps Killed
Unit
tasks per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

maps_launched_rate

Description
Maps Launched
Unit
tasks per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

maps_running

Description
Maps Running
Unit
tasks
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

mem_rss

Description
Resident memory used
Unit
bytes
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

mem_swap

Description
Amount of swap memory used by this role's process.
Unit
bytes
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

mem_virtual

Description
Virtual memory used
Unit
bytes
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

occupied_map_slots

Description
Occupied Map Slots
Unit
slots
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

occupied_reduce_slots

Description
Occupied Reduce Slots
Unit
slots
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

oom_exits_rate

Description
The number of times the role's backing process was killed due to an OutOfMemory error. This counter is only incremented if the Cloudera Manager "Kill When Out of Memory" option is enabled.
Unit
exits per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

read_bytes_rate

Description
The number of bytes read from the device
Unit
bytes per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

reduce_slots

Description
Reduce slots
Unit
slots
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduces_completed_rate

Description
Reduces Completed
Unit
tasks per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduces_failed_rate

Description
Reduces failed
Unit
tasks per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduces_killed_rate

Description
Reduces Killed
Unit
tasks per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduces_launched_rate

Description
Reduces Launched
Unit
tasks per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduces_running

Description
Reduces Running
Unit
tasks
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reserved_map_slots

Description
Reserved Map Slots
Unit
slots
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reserved_reduce_slots

Description
Reserved Reduce Slots
Unit
slots
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

trackers

Description
TaskTrackers
Unit
TaskTrackers
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

trackers_blacklisted

Description
TaskTrackers Blacklisted
Unit
TaskTrackers
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

trackers_decommissioned

Description
TaskTrackers Decommissioned
Unit
TaskTrackers
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

unexpected_exits_rate

Description
The number of times the role's backing process exited unexpectedly.
Unit
exits per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

uptime

Description
For a host, the amount of time since the host was booted. For a role, the uptime of the backing process.
Unit
seconds
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]

waiting_maps

Description
Waiting Maps
Unit
tasks
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

waiting_reduces

Description
Waiting Reduces
Unit
tasks
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

web_metrics_collection_duration

Description
Web Server Responsiveness
Unit
ms
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0)

write_bytes_rate

Description
The number of bytes written to the device
Unit
bytes per second
Parents
cluster, mapreduce, rack
CDH Version
[CDH 5.0.0..CDH 6.0.0), [CDH 6.0.0..CDH 7.0.0), [CDH 7.0.0..CDH 8.0.0), [CM -1.0.0..CM -1.0.0]