Managing the Spark History Server
The Spark History Server displays information about the history of completed Spark applications. For further information, see Monitoring Spark Applications.
For instructions for configuring the Spark History Server to use Kerberos, see Spark Authentication.
Adding the Spark History Server Using Cloudera Manager
By default, the Spark (Standalone) service does not include a History Server. To configure applications to store history, on Spark clients, set spark.eventLog.enabled to true before starting the application.
Minimum Required Role: Cluster Administrator (also provided by Full Administrator)
To add the History Server:
- Go to the Spark service.
- Click the Instances tab.
- Click the Add Role Instances button.
- Select a host in the column under History Server, and then click OK.
- Click Continue.
- Check the checkbox next to the History Server role.
- Select Start. and click
- Click Close when the action completes.