Cloudera Docs

Running deep analysis on a Cloudera Data Engineering job run

You can run an on-demand deep analysis on a Cloudera Data Engineering (CDE) job run to generate detailed information, including memory utilization and stage-level analysis.

  • You must enable deep analysis for the job you want to analyze and run the job once to collect data.
You can only analyze job runs that took place after Spark Analysis was enabled for the job.
  1. From the CDE Overview page, select the CDE service for the job you want to troubleshoot or analyze.
  2. In the Virtual Clusters column, click the View Jobs icon for the cluster containing the job.
  3. In the Run History tab, click the Job ID for the job run you want to analyze.
  4. Go to the Analysis tab.
  5. Click Run Deep Analysis.
After the deep analysis job completes, you can view additional job run information in the Analysis tab for the job run.