Spark Prerequisites

Before installing Spark, make sure your cluster meets the following prerequisites.

Table 19.1. Prerequisites for running Spark 1.6

Prerequisite	Description
Cluster Stack Version	HDP 2.4.2 or later
(Optional) Ambari Version	2.2.1 or later
Software dependencies	Spark requires HDFS and YARN PySpark requires Python to be installed on all nodes

	Note
	HDP 2.4.2 supports several versions of Apache Spark. When you install HDP 2.4.2, Spark 1.6 is installed. If you prefer to use an earlier version of Spark, follow the Spark Manual Downgrade procedure in the Release Notes.

​Spark Prerequisites