Installing and Upgrading Spark

To see which version of Spark is shipping in the current release, check the CDH Version and Packaging Information. For important information, see the CDH 5 Release Notes, in particular:
  • RHEL-compatible system:
    • To install all Spark packages: 
      $ sudo yum install spark-core spark-master spark-worker spark-history-server spark-python
    • To install only the packages needed to run Spark on YARN: 
      $ sudo yum install spark-core spark-history-server spark-python
  • SLES system:
    • To install all Spark packages: 
      $ sudo zypper install spark-core spark-master spark-worker spark-history-server spark-python
    • To install only the packages needed to run Spark on YARN: 
      $ sudo zypper install spark-core spark-history-server spark-python
  • Ubuntu or Debian system:
    • To install all Spark packages: 
      $ sudo apt-get install spark-core spark-master spark-worker spark-history-server spark-python
    • To install only the packages needed to run Spark on YARN: 
      $ sudo apt-get install spark-core spark-history-server spark-python
You are now ready to configure and start Spark. See Managing Spark Standalone Using the Command Line.