Cloudera Docs

Identifying inefficient jobs and queries

Identify inefficient jobs or queries for resource optimization, such as viewing the top queries or jobs by CPU wastage and memory wastage or viewing the CPU and memory consumption for the selected query.

Describes how to locate the Cloudera Observability Resource Efficiency Analysis chart widget for identifying inefficient jobs and Hive queries.

  1. Verify that you are logged in to the Cloudera Observability web UI and that you selected an environment from the Analytics Environments page.
    1. In a supported browser, log into the Cloudera Data Platform (CDP).
      The CDP web interface landing page opens.
    2. From the Your Enterprise Data Cloud landing page, select the Observability tile.
      The Cloudera Observability landing page opens to the main navigation panel.
    3. From the Cloudera Observability Environments page, select the environment required for analysis.

      The Environment navigation panel opens.

  2. Depending on the environment selected, verify that the Cluster Summary page is displayed for the environment's cluster required for analysis.
    To display the Cluster Summary page, do one of the following:
    • For Private Cloud Base and Classic Cluster environment types, verify that the Cluster Summary title is displayed in the browser tab.
    • For Data Hub and Database Catalog environment types, expand its Data Lake category in the Environment's panel and then locate and select the cluster.

    The Cluster Summary page displays a series of performance trends and metric chart widgets about the processed jobs and queries.

  3. Go to the Analytics tab.
  4. Optional: From the time-range list in the Cluster Summary page, select a time period that meets your requirements.
  5. From the Environment navigation panel expand the Engines list, and select Hive engine.
  6. On the Hive Summary page, locate the Resource Efficiency Analysis chart widget. The Resource Efficiency Analysis chart widget displays resource wastage analysis across queries. See Resource efficiency analysis across queries.
  7. In the Resource Efficiency Analysis chart, from the Queries column, locate and select the query for which you want to view resource efficiency and potential savings metrics. See Resource efficiency and potential savings metrics.