Installing CDS 2 Powered by Apache Spark

Minimum Required Role: Cluster Administrator (also provided by Full Administrator)

CDS 2 Powered by Apache Spark is distributed as two files: a CSD file and a parcel, both of which need to installed on the cluster. You can install Spark2 using the following instructions.

If your Cloudera Manager Server does have Internet access, you can use the CSD and proceed with the following instructions:

  1. Download the Spark2 CSD.
  2. Install the Spark2 CSD into Cloudera Manager as described in Installing an Add-on Service.
  3. In the Cloudera Manager Admin Console, add the Spark2 parcel repository to the remote repository URLs.
  4. Download the Spark2 parcel, distribute the parcel to the hosts in your cluster, and activate the parcel. See Managing Parcels.
  5. Add the Spark 2 service to your cluster. When configuring the assignment of role instances to hosts, add a gateway role to every host. The History Server port is 18089 instead of the usual 18088.
  6. Return to the Home page by clicking the Cloudera Manager logo.
  7. Click to invoke the cluster restart wizard.
  8. Click Restart Stale Services.
  9. Click Restart Now.
  10. Click Finish.