Cloudera Docs

Check Job History

You can use the following resources to view job history:

  • Spark History Server UI: view information about Spark jobs that have completed.

    1. In the Cloudera Management Console, go to Data Hub Clusters.
    2. Open the Cloudera Management Console.
    3. Find and select the cluster you want to configure.
    4. Click the Spark History Server link.

  • YARN web UI: view job history and time spent in various stages of the job:

    1. In the Cloudera Data Platform (CDP) Management Console, go to Data Hub Clusters.
    2. Open the Cloudera Management Console.
    3. Find and select the cluster you want to configure.
    4. Click the Resource Manager link.
    5. Select the Applications tab.
  • yarn logs command: list the contents of all log files from all containers associated with the specified application:
    yarn logs -applicationId <app_id>