Cloudera Docs

Identifying inefficient jobs and queries

Identify inefficient jobs or queries for resource optimization, such as viewing the top queries or jobs by CPU wastage and memory wastage or viewing the CPU and memory consumption for the selected query.

Describes how to locate the Cloudera Observability On-Premises Resource Efficiency Analysis chart widget for identifying inefficient jobs and queries.

  1. Verify that you are logged in to the Cloudera Observability On-Premises web UI.
    1. In the URL field of a supported web browser, enter the Cloudera Observability On-Premises URL that you were given by your system administrator and press Enter.
    2. When the Cloudera Observability On-Premises Log in page opens, enter your Cloudera Observability On-Premises user name and password access credentials.
    3. Click Log in.
      The Cloudera Observability On-Premises web user interface landing page opens, which by default displays the Analytics Environments page that lists your Workload cluster environments.
    4. From the Environment Name column in the Environment's table, select the environment required for analysis.

      The Environments navigation panel opens, which hierarchically lists the environment's cluster, engines, and if applicable the Hive Metastore category.

  2. Depending on the environment selected, verify that the Cluster Summary page is displayed for the environment's cluster required for analysis.
  3. Go to the Analytics tab.
  4. Optional: From the time-range list in the Cluster Summary page, select a time period that meets your requirements.
  5. From the Environment navigation panel expand the Engines list, and select Hive engine.
  6. On the Hive Summary page, locate the Resource Efficiency Analysis chart widget. The Resource Efficiency Analysis chart widget displays resource wastage analysis across queries. See Resource efficiency analysis across queries.
  7. In the Resource Efficiency Analysis chart, from the Queries column, locate and select the query for which you want to view resource efficiency and potential savings metrics. See Resource efficiency and potential savings metrics.