Check Job History

You can use the following resources to view job history:

• Spark History Server UI: view information about Spark jobs that have completed.

  1. In the , go to .
  2. Open the .
  3. Find and select the cluster you want to configure.
  4. Click the Spark History Server link.

• YARN web UI: view job history and time spent in various stages of the job:

  1. In the , go to .
  2. Open the .
  3. Find and select the cluster you want to configure.
  4. Click the Resource Manager link.
  5. Select the Applications tab.
• yarn logs command: list the contents of all log files from all containers associated with the specified application:

  yarn logs -applicationId <app_id>