Configuring Apache Spark
Also available as:
PDF

Configuring the Spark History Server

Use the following steps to configure the Apache Spark history server.

The Spark history server is a monitoring tool that displays information about completed Spark applications. This information is pulled from the data that applications by default write to a directory on Hadoop Distributed File System (HDFS).

To access the Spark history server, click Spark2 in the Ambari Dashboard, then click Spark2 History Server UI under "Quick Links".

Ambari Admin users can see the history of all Spark jobs. Other users can only see the history of jobs they submitted.