Configuring the Spark History Server

The Spark history server is a monitoring tool that displays information about completed Spark applications. This information is pulled from the data that applications by default write to a directory on Hadoop Distributed File System (HDFS).

To access the Spark history server, click Spark2 in the Ambari Dashboard, then click Spark2 History Server UI under "Quick Links".

Ambari Admin users can see the history of all Spark jobs. Other users can only see the history of jobs they submitted.