The Spark history server is a monitoring tool that displays information about completed Spark applications. This information is pulled from the data that applications by default write to a directory on Hadoop Distributed File System (HDFS). The information is then presented in a web UI at <host>:<port>. (The default port is 18080.)

For information about configuring optional history server properties, see the Apache Monitoring and Instrumentation document.