Installing CDS 3.0 (Experimental) Powered by Apache Spark

CDS 3.0 (Experimental) Powered by Apache Spark is distributed as two files: a custom service descriptor file and a parcel, both of which must be installed on the cluster.

Install CDS Powered by Apache Spark

Follow these steps to install CDS 3 Powered by Apache Spark:

Check that all the software prerequisites are satisfied. If not, you might need to upgrade or install other software components first.
Install the CDS Powered by Apache Spark service descriptor into Cloudera Manager.
1. To download the CDS Powered by Apache Spark service descriptor, click the service descriptor link for the version you want to install.
2. Log on to the Cloudera Manager Server host, and copy the CDS Powered by Apache Spark service descriptor in the location configured for service descriptor files.
3. Set the file ownership of the service descriptor to cloudera-scm:cloudera-scm with permission 644.
4. Restart the Cloudera Manager Server with the following command:
```
systemctl restart cloudera-scm-server
```
In the Cloudera Manager Admin Console, add the CDS parcel repository to the Remote Parcel Repository URLs in Parcel Settings as described in Parcel Configuration Settings.
note
If your Cloudera Manager Server does not have Internet access, you can use the CDS Powered by Apache Spark parcel files: put them into a new parcel repository, and then configure the Cloudera Manager Server to target this newly created repository.
Download the CDS Powered by Apache Spark parcel, distribute the parcel to the hosts in your cluster, and activate the parcel. For instructions, see Managing Parcels.
Add the Spark 3 service to your cluster.
1. In step 1, select any optional dependencies, such as HBase and Hive, or select No Optional Dependencies.
2. In step 2, when customizing the role assignments, add a gateway role to every host.
3. On the Review Changes page, you can enable TLS for the Spark History Server.
4. Note that the History Server port is 18089 instead of the usual 18088.
5. Complete the remaining steps in the wizard.
Return to the Home page by clicking the Cloudera Manager logo in the upper left corner.
Click the stale configuration icon to launch the Stale Configuration wizard and restart the necessary services.