JournalNode Metrics
In addition to these base metrics, many aggregate metrics are available.
If an entity type has parents defined, you can formulate all possible
aggregate metrics using the formula
base_metric_across_parents.
In addition, metrics for aggregate totals can be formed by adding the prefix
total_ to the front of the metric name.
Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".
For example, the following metric names may be valid for JournalNode:
-
accept_recovery_avg_time_across_clusters -
total_accept_recovery_avg_time_across_clusters
Some metrics, such as alerts_rate, apply to nearly every metric context. Others only apply to a
certain service or role.
| Metric Name | Description | Unit | Parents | Version |
|---|---|---|---|---|
| accept_recovery_avg_time | Accept Recovery Average Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| accept_recovery_rate | Accept Recovery Operations | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| alerts_rate | The number of alerts. | events per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| batches_written_rate | Batches Written | batches per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| batches_written_while_lagging_rate | Batches Written While Lagging | batches per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| bytes_written_rate | Bytes Written | bytes per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| cgroup_cpu_system_rate | CPU usage of the role's cgroup | seconds per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| cgroup_cpu_user_rate | User Space CPU usage of the role's cgroup | seconds per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| cgroup_mem_page_cache | Page cache usage of the role's cgroup | bytes | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| cgroup_mem_rss | Resident memory of the role's cgroup | bytes | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| cgroup_mem_swap | Swap usage of the role's cgroup | bytes | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| cgroup_read_bytes_rate | Bytes read from all disks by the role's cgroup | bytes per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| cgroup_read_ios_rate | Number of read I/O operations from all disks by the role's cgroup | ios per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| cgroup_write_bytes_rate | Bytes written to all disks by the role's cgroup | bytes per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| cgroup_write_ios_rate | Number of write I/O operations to all disks by the role's cgroup | ios per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| cpu_system_rate | Total System CPU | seconds per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| cpu_user_rate | Total CPU user time | seconds per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| current_lag_txns_journalnode | The number of transactions by which this JournalNode's log is lagging behind the quorum as reported by the JournalNode | transactions | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| current_lag_txns_namenode | The number of transactions by which this JournalNode's log is lagging behind the quorum as reported by the NameNode | transactions | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| events_critical_rate | The number of critical events. | events per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| events_important_rate | The number of important events. | events per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| events_informational_rate | The number of informational events. | events per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| fd_max | Maximum number of file descriptors | file descriptors | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| fd_open | Open file descriptors. | file descriptors | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| finalize_log_segment_avg_time | Finalize Log Segment Average Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| finalize_log_segment_rate | Finalize Log Segment Operations | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| format_avg_time | The average time for format operations. | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| format_rate | The total number of format operations. | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| get_edit_log_manifest_avg_time | Get Edit Log Manifest Average Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| get_edit_log_manifest_rate | Get Edit Log Manifest Operations | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| get_hadoop_groups_avg_time | Average Time to get Hadoop group for the user | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| get_hadoop_groups_rate | Get Hadoop User Operations | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| get_journal_state_avg_time | Get Journal State Average Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| get_journal_state_rate | Get Journal State Operations | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| health_bad_rate | Percentage of Time with Bad Health | seconds per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| health_concerning_rate | Percentage of Time with Concerning Health | seconds per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| health_disabled_rate | Percentage of Time with Disabled Health | seconds per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| health_good_rate | Percentage of Time with Good Health | seconds per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| health_unknown_rate | Percentage of Time with Unknown Health | seconds per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| is_formatted_avg_time | The average time for is formatted operations. | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| is_formatted_rate | The total number of is formatted operations. | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| journal_avg_time | Journal Average Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| journal_rate | Journal Operations | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_blocked_threads | Blocked threads | threads | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_gc_rate | Number of garbage collections | garbage collections per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_gc_time_ms_rate | Total time spent garbage collecting. | ms per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_heap_committed_mb | Total amount of committed heap memory. | MB | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_heap_used_mb | Total amount of used heap memory. | MB | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_max_memory_mb | Maximum allowed memory. | MB | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_new_threads | New threads | threads | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_non_heap_committed_mb | Total amount of committed non-heap memory. | MB | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_non_heap_used_mb | Total amount of used non-heap memory. | MB | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_runnable_threads | Runnable threads | threads | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_terminated_threads | Terminated threads | threads | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_timed_waiting_threads | Timed waiting threads | threads | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_total_threads | Total threads | threads | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| jvm_waiting_threads | Waiting threads | threads | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| lag_time_millis | The amount of time by which this JournalNode's log is lagging behind the quorum | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| last_promised_epoch | Last Promised Epoch | epoch | CDH 5, CDH 6, Cloudera Runtime 7 | |
| last_writer_epoch | Last Writer Epoch | epoch | CDH 5, CDH 6, Cloudera Runtime 7 | |
| log_error_rate | Logged Errors | messages per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| log_fatal_rate | Logged Fatals | messages per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| log_info_rate | Logged Infos | messages per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| log_warn_rate | Logged Warnings | messages per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| login_failure_avg_time | Average Failed Login Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| login_failure_rate | Login Failures | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| login_success_avg_time | Average Successful Login Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| login_success_rate | Login Successes | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| mem_rss | Resident memory used | bytes | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| mem_swap | Amount of swap memory used by this role's process. | bytes | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| mem_virtual | Virtual memory used | bytes | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| metrics_dropped_pub_all | Dropped Metrics Updates By All Sinks | updates | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| metrics_num_active_sinks | Active Metrics Sinks Count | sinks | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| metrics_num_active_sources | Active Metrics Sources Count | sources | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| metrics_num_all_sinks | All Metrics Sinks Count | sinks | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| metrics_num_all_sources | All Metrics Sources Count | sources | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| metrics_publish_avg_time | Metrics Publish Average Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| metrics_publish_rate | Metrics Publish Operations | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| metrics_snapshot_avg_time | Metrics Snapshot Average Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| metrics_snapshot_rate | Metrics Snapshot Average Operations | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| new_epoch_avg_time | New Epoch Average Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| new_epoch_rate | New Epoch Average Operations | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| oom_exits_rate | The number of times the role's backing process was killed due to an OutOfMemory error. This counter is only incremented if the Cloudera Manager "Kill When Out of Memory" option is enabled. | exits per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| prepare_recovery_avg_time | Prepare Recovery Average Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| prepare_recovery_rate | Prepare Recovery Operations | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| purge_logs_avg_time | Purge Logs Average Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| purge_logs_rate | Purge Logs Operations | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| queued_edits_size | The size in bytes of the edits currently queued by the active NameNode to this JournalNode | bytes | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| read_bytes_rate | The number of bytes read from the device | bytes per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| rpc_authentication_failures_rate | RPC Authentication Failures | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| rpc_authentication_successes_rate | RPC Authentication Successes | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| rpc_authorization_failures_rate | RPC Authorization Failures | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| rpc_authorization_successes_rate | RPC Authorization Successes | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| rpc_call_queue_length | RPC Call Queue Length | items | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| rpc_num_open_connections | Open RPC Connections | connections | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| rpc_processing_time_avg_time | Average RPC Processing Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| rpc_processing_time_rate | RPCs Processed | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| rpc_queue_time_avg_time | Average RPC Queue Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| rpc_queue_time_rate | RPCs Queued | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| rpc_received_bytes_rate | RPC Received Bytes | bytes per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| rpc_sent_bytes_rate | RPC Sent Bytes | bytes per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| start_log_segment_avg_time | Start Log Segment Average Time | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| start_log_segment_rate | Start Log Segment Average Operations | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs300s50th_percentile_latency_micros | Sync Latency 5 Minutes 50% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs300s75th_percentile_latency_micros | Sync Latency 5 Minutes 75% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs300s90th_percentile_latency_micros | Sync Latency 5 Minutes 90% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs300s95th_percentile_latency_micros | Sync Latency 5 Minutes 95% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs300s99th_percentile_latency_micros | Sync Latency 5 Minutes 99% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs300s_rate | Sync Operations: Five Minute Granularity | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs3600s50th_percentile_latency_micros | Sync Latency Hour 50% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs3600s75th_percentile_latency_micros | Sync Latency Hour 75% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs3600s90th_percentile_latency_micros | Sync Latency Hour 90% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs3600s95th_percentile_latency_micros | Sync Latency Hour 95% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs3600s99th_percentile_latency_micros | Sync Latency Hour 99% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs3600s_rate | Sync Operations: One Hour Granularity | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs60s50th_percentile_latency_micros | Sync Latency Minute 50% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs60s75th_percentile_latency_micros | Sync Latency Minute 75% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs60s90th_percentile_latency_micros | Sync Latency Minute 90% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs60s95th_percentile_latency_micros | Sync Latency Minute 95% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs60s99th_percentile_latency_micros | Sync Latency Minute 99% | micros | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| syncs60s_rate | Sync Operations: One Minute Granularity | operations per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| txns_written_rate | Transactions Written | transactions per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| unexpected_exits_rate | The number of times the role's backing process exited unexpectedly. | exits per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| uptime | For a host, the amount of time since the host was booted. For a role, the uptime of the backing process. | seconds | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| web_metrics_collection_duration | Web Server Responsiveness | ms | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
| write_bytes_rate | The number of bytes written to the device | bytes per second | cluster, hdfs, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
