Impala StateStore Metrics
In addition to these base metrics, many aggregate metrics are available.
If an entity type has parents defined, you can formulate all possible
aggregate metrics using the formula
base_metric_across_parents
.
In addition, metrics for aggregate totals can be formed by adding the prefix
total_
to the front of the metric name.
Use the type-ahead feature in the Cloudera Manager chart browser to find the exact aggregate metric name, in case the plural form does not end in "s".
For example, the following metric names may be valid for Impala StateStore:
-
alerts_rate_across_clusters
-
total_alerts_rate_across_clusters
Some metrics, such as alerts_rate
, apply to nearly every metric context. Others only apply to a
certain service or role.
Metric Name | Description | Unit | Parents | Version |
---|---|---|---|---|
alerts_rate | The number of alerts. | events per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
cgroup_cpu_system_rate | CPU usage of the role's cgroup | seconds per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
cgroup_cpu_user_rate | User Space CPU usage of the role's cgroup | seconds per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
cgroup_mem_page_cache | Page cache usage of the role's cgroup | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
cgroup_mem_rss | Resident memory of the role's cgroup | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
cgroup_mem_swap | Swap usage of the role's cgroup | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
cgroup_read_bytes_rate | Bytes read from all disks by the role's cgroup | bytes per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
cgroup_read_ios_rate | Number of read I/O operations from all disks by the role's cgroup | ios per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
cgroup_write_bytes_rate | Bytes written to all disks by the role's cgroup | bytes per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
cgroup_write_ios_rate | Number of write I/O operations to all disks by the role's cgroup | ios per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
cpu_system_rate | Total System CPU | seconds per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
cpu_user_rate | Total CPU user time | seconds per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
events_critical_rate | The number of critical events. | events per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
events_important_rate | The number of important events. | events per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
events_informational_rate | The number of informational events. | events per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
fd_max | Maximum number of file descriptors | file descriptors | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
fd_open | Open file descriptors. | file descriptors | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
health_bad_rate | Percentage of Time with Bad Health | seconds per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
health_concerning_rate | Percentage of Time with Concerning Health | seconds per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
health_disabled_rate | Percentage of Time with Disabled Health | seconds per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
health_good_rate | Percentage of Time with Good Health | seconds per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
health_unknown_rate | Percentage of Time with Unknown Health | seconds per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
mem_rss | Resident memory used | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
mem_swap | Amount of swap memory used by this role's process. | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
mem_virtual | Virtual memory used | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
oom_exits_rate | The number of times the role's backing process was killed due to an OutOfMemory error. This counter is only incremented if the Cloudera Manager "Kill When Out of Memory" option is enabled. | exits per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
read_bytes_rate | The number of bytes read from the device | bytes per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
statestore_live_backends | The number of active subscribers to this this StateStore. | backends | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
statestore_total_key_size_bytes | The sum of the size of all keys for all topics tracked by the StateStore. | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
statestore_total_topic_size_bytes | The sum of the size of all keys and all values for all topics tracked by the StateStore. | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
statestore_total_value_size_bytes | The sum of the size of all values for all topics tracked by the StateStore. | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
subscriber_client_cache_clients_in_use | The total number of active subscriber clients in this StateStore's client cache. These clients are for communication with Impala Daemons. | connections | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
subscriber_client_cache_total_clients | The total number of subscriber clients in this StateStore's client cache. These clients are for communication with Impala Daemons. | connections | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
tcmalloc_bytes_in_use | Number of bytes used by the application. This will not typically match the memory use reported by the OS, because it does not include TCMalloc overhead or memory fragmentation. | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
tcmalloc_pageheap_free_bytes | Number of bytes in free, mapped pages in page heap. These bytes can be used to fulfill allocation requests. They always count towards virtual memory usage, and unless the underlying memory is swapped out by the OS, they also count towards physical memory usage. | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
tcmalloc_pageheap_unmapped_bytes | Number of bytes in free, unmapped pages in page heap. These are bytes that have been released back to the OS, possibly by one of the MallocExtension "Release" calls. They can be used to fulfill allocation requests, but typically incur a page fault. They always count towards virtual memory usage, and depending on the OS, typically do not count towards physical memory usage. | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
tcmalloc_physical_bytes_reserved | Derived metric computing the amount of physical memory (in bytes) used by the process, including that actually in use and free bytes reserved by tcmalloc. Does not include the tcmalloc metadata. | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
tcmalloc_total_bytes_reserved | Bytes of system memory reserved by TCMalloc. | bytes | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
thread_manager_running_threads | The number of running threads in this process. | threads | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
thread_manager_threads_created_rate | Threads created over the lifetime of the process. | threads per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
thrift_server_state_store_service_connections_in_use | The number of active connections to this StateStore's StateStore service. | connections | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
thrift_server_state_store_service_connections_rate | The total number of connections made to this StateStore's StateStore service over its lifetime. | connections per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
unexpected_exits_rate | The number of times the role's backing process exited unexpectedly. | exits per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
uptime | For a host, the amount of time since the host was booted. For a role, the uptime of the backing process. | seconds | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
web_metrics_collection_duration | Web Server Responsiveness | ms | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |
write_bytes_rate | The number of bytes written to the device | bytes per second | cluster, impala, rack | CDH 5, CDH 6, Cloudera Runtime 7 |