Activity Metrics

Reference information for Activity Metrics

In addition to these base metrics, many aggregate metrics are available. If an entity type has parents defined, you can formulate all possible aggregate metrics using the formula base_metric_across_parents.

In addition, metrics for aggregate totals can be formed by adding the prefix total_ to the front of the metric name.

Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".

combine_input_records

Description
Number of input records to combiner
Unit
records
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

combine_output_records

Description
Number of records output by combiner
Unit
records
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

cpu_system

Description
Kernel CPU time used (CPUs / s)
Unit
CPU seconds per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

cpu_system_rate

Description
Total System CPU
Unit
seconds per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

cpu_user

Description
Current User CPUs
Unit
CPU seconds per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

cpu_user_rate

Description
Total CPU user time
Unit
seconds per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

data_local_maps

Description
Number of map tasks reading local data
Unit
tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

disk_read_rate

Description
Reads from local disk (bytes)
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

disk_write_rate

Description
Writes to local disk (bytes)
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

duration

Description
Activity or attempt duration
Unit
ms
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

fairscheduler_demand

Description
Fair Scheduler demand
Unit
Fair Scheduler demand
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

fairscheduler_fair_share

Description
Fair Scheduler fair share
Unit
Fair Scheduler fair share
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

fairscheduler_min_share

Description
Fair Scheduler minimum share
Unit
Fair Scheduler min share
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

fairscheduler_running_tasks

Description
Fair Scheduler running tasks
Unit
Fair Scheduler running tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

fairscheduler_weight

Description
Fair Scheduler weight
Unit
Fair Scheduler weight
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

fallow_slots_millis_maps

Description
Total time spent by all map tasks waiting after reserving slots
Unit
ms
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

fallow_slots_millis_reduces

Description
Total time spent by all reduce tasks waiting after reserving slots
Unit
ms
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

hdfs_read_rate

Description
Reads from HDFS (bytes)
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

hdfs_write_rate

Description
Writes to HDFS (bytes)
Unit
bytes per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

map_input_bytes

Description
Input to map task (bytes)
Unit
bytes
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

map_input_records

Description
Number of input records to map task
Unit
records
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

map_output_bytes

Description
Output from map task (bytes)
Unit
bytes
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

map_output_records

Description
Number of records output by map task
Unit
records
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

map_progress

Description
Activity map-phase progress
Unit
progress
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

maps_failed_rate

Description
Maps Failed
Unit
tasks per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

maps_running

Description
Maps Running
Unit
tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

mem_rss

Description
Resident memory used
Unit
bytes
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

mem_virtual

Description
Virtual memory used
Unit
bytes
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

num_desired_maps

Description
Desired map tasks
Unit
tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

num_desired_reduces

Description
Desired reduce tasks
Unit
tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

other_local_maps

Description
Other-local maps
Unit
tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

rack_local_maps

Description
Rack-local map tasks
Unit
tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduce_input_records

Description
Number of records input to reduce task
Unit
records
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduce_output_records

Description
Number of records output by reduce task
Unit
records
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduce_progress

Description
Activity reduce-phase progress
Unit
progress
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduce_shuffle_bytes

Description
Number of bytes in reduce shuffle
Unit
bytes
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduces_failed_rate

Description
Reduces failed
Unit
tasks per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduces_running

Description
Reduces Running
Unit
tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduces_running_in_reduce_phase

Description
Reduce Reduces Running
Unit
tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduces_running_in_shuffle_phase

Description
Shuffle Reduces Running
Unit
tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

reduces_running_in_sort_phase

Description
Sort Reduces Running
Unit
tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

slots_millis_maps

Description
Total time spent by all map tasks in execution
Unit
ms
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

slots_millis_reduces

Description
Total time spent by all reduce tasks in execution
Unit
ms
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

spilled_records_rate

Description
Number of spilled records
Unit
records per second
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

split_raw_bytes

Description
Number of raw split bytes
Unit
bytes
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

total_launched_maps

Description
Total launched map task attempts
Unit
tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)

total_launched_reduces

Description
Total launched reduce task attempts
Unit
tasks
Parents
CDH Version
[CDH 5.0.0..CDH 6.0.0)