Cloudera Docs

Enabling Spark Encryption

Before enabling encryption, you must first enable Spark authentication.

  1. In the Cloudera Data Platform (CDP) Management Console, go to Data Hub Clusters.
  2. Find and select the cluster you want to configure.
  3. Click the link for the Cloudera Manager URL.
  4. Go to Clusters > <Cluster Name> > Spark service > Configuration.
  5. Search for the Enable Network Encryption property. Use the checkbox to enable encrypted communication between Spark processes belonging to the same application.
  6. Search for the Enable I/O Encryption property. Use the checkbox to enabled encryption for temporary shuffle and cache files stored by Spark on local disks.
  7. Enter the reason for the change at the bottom of the screen, and then click Save Changes.
  8. Re-deploy the client configurations:
    1. Select Clusters > Cluster_name
    2. Select Deploy Client Configurations from the Actions drop-down selector.
  9. Restart stale services.