Configuring Apache Spark
Also available as:

Configuring Spark for a Kerberos-enabled Cluster

This section describes how to configure Apache Spark for a Kerberos-enabled cluster.

Before running Spark jobs on a Kerberos-enabled cluster, configure additional settings for the following modules and scenarios:

  • Spark history server

  • Spark Thrift server

  • Individuals who submit jobs

  • Processes that submit jobs without human interaction

Each of these scenarios is described in the following subsections.

When Kerberos is enabled on an Ambari-managed cluster, Livy configuration for Kerberos is handled automatically.