Chapter 2. Prerequisites
Before installing Spark, make sure your cluster meets the following prerequisites.
Table 2.1. Prerequisites for Running Spark
| Prerequisite | Description |
|---|
| HDP Cluster Stack Version |
|
| (Optional) Ambari Version |
|
| Software dependencies |
Spark requires HDFS and YARN PySpark requires Python to be installed on all nodes (Optional) The Spark Thrift Server requires Hive to be deployed on your
cluster (Optional) For optimal performance with MLlib, consider installing the
netlib-java library. SparkR (tech preview) requires R binaries to be installed on all
nodes
|
