The Spark History Server is a monitoring tool that lists information about completed Spark applications. Applications write history data to a directory on HDFS (by default). The History Server pulls the data from HDFS and presents it in a Web UI at <host>:18080 (by default).

For information about configuring optional History Server properties, see the Apache Monitoring and Instrumentation document.

For Kerberos considerations, see Configuring Spark for a Kerberos-Enabled Cluster