Query and job resource optimization using resource efficiency analysis
You can evaluate the efficiency of individual jobs or queries based on the insights related to the resources requested versus the actual consumption. Queries or jobs with excess resource allocation waste cluster resources that can be better utilized for other tasks. Therefore, it is important to identify and analyze these inefficient jobs or queries.
Resource efficiency analysis feature availability
The Cloudera Observability
Resource efficiency analysis helps you understand how efficiently the
allocated resources are used.
- Capability: Requires the Cloudera Observability Premium on cloud license tier. To learn more about the Cloudera Observability Premium on cloud license tier and to request a demo, see the Cloudera Observability product website.
- Environments: Available for Cloudera Base on premises and Cloudera Data Hub environments.
- Engines: Available for Hive and Spark engines.
Query or job cost analysis availability
The Cloudera Observability
Query Cost or Job Cost analysis shows a breakdown
of the query or job to help you understand the costs better.
- Capability: Requires the Cloudera Observability Premium on cloud license tier.
- Environments: Available for Cloudera Base on premises, Cloudera Data Hub, and Cloudera Data Warehouse environments.
- Engines: Available for Hive, Impala, and Spark engines.
Key benefits
- Identifies inefficiencies: Highlight jobs or queries that over-allocate resources such as CPU and memory.
- Optimizes resource allocation: Ensure resources are allocated more efficiently, reducing waste and improving overall system performance.
- Cost analysis: Provides insights into costs associated with different resources used by the query.
