Cloudera Docs

Running deep analysis on a Cloudera Data Engineering job run

You can run an on-demand deep analysis on a Cloudera Data Engineering (CDE) job run to generate detailed information, including memory utilization and stage-level analysis.

Because deep analysis consumes cluster resources by running an internal CDE job, you must run it manually for any job run you want to analyze or troubleshoot.

  1. From the CDE Overview page, select the CDE service for the job you want to troubleshoot or analyze.
  2. In the Virtual Clusters column, click the View Jobs icon for the cluster containing the job.
  3. Select the job you want to analyze.
  4. In the Run History tab, click the Job ID for the job run you want to analyze.
  5. Go to the Analysis tab.
  6. Click the Run Deep Analysis button.
After the deep analysis job completes, you can view additional job run information in the Analysis tab for the job run.