HDFS Metrics
In addition to these base metrics, many aggregate metrics are available.
If an entity type has parents defined, you can formulate all possible
aggregate metrics using the formula
base_metric_across_parents
.
In addition, metrics for aggregate totals can be formed by adding the prefix
total_
to the front of the metric name.
Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".
For example, the following metric names may be valid for HDFS:
-
alerts_rate_across_clusters
-
total_alerts_rate_across_clusters
Some metrics, such as alerts_rate
, apply to nearly every metric context. Others only apply to a
certain service or role.
Metric Name | Description | Unit | Parents | Version |
---|---|---|---|---|
alerts_rate | The number of alerts. | events per second | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
block_capacity | The block capacity of the NameNode | blocks | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
blocks_total | Blocks total | blocks | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
blocks_with_corrupt_replicas | Blocks with corrupt replicas | blocks | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
canary_duration | Duration of the last or currently running canary job | ms | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
cm_time_since_last_fsimage_fetch | Time since last FsImage was fetched by Cloudera Reports Manager | seconds | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
cm_time_since_last_fsimage_index | Time since last FsImage was indexed By Cloudera Reports Manager | seconds | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
dfs_capacity | Total configured HDFS storage capacity | bytes | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
dfs_capacity_used | Storage space used by HDFS files | bytes | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
dfs_capacity_used_non_hdfs | Storage space used by non-HDFS files | bytes | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
events_critical_rate | The number of critical events. | events per second | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
events_important_rate | The number of important events. | events per second | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
events_informational_rate | The number of informational events. | events per second | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
excess_blocks | The total number of excess blocks | blocks | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
expired_heartbeats | The number of expired heartbeats | heartbeats | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
files_total | The number of files and directories in the HDFS | files | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
health_bad_rate | Percentage of Time with Bad Health | seconds per second | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
health_concerning_rate | Percentage of Time with Concerning Health | seconds per second | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
health_disabled_rate | Percentage of Time with Disabled Health | seconds per second | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
health_good_rate | Percentage of Time with Good Health | seconds per second | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
health_unknown_rate | Percentage of Time with Unknown Health | seconds per second | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
missing_blocks | Missing blocks | blocks | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
pending_deletion_blocks | The number of replicas pending deletion. | replicas | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
pending_replication_blocks | The number of blocks with replication pending | blocks | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
scheduled_replication_blocks | The number of blocks with replication currently scheduled | blocks | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
under_replicated_blocks | Under-replicated blocks | blocks | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |
xceivers | Transceivers | transceivers | cluster | CDH 5, CDH 6, Cloudera Runtime 7 |