Security Considerations for CDS Powered by Apache Spark

The following sections cover any special considerations for security in CDS Powered by Apache Spark, or differences in security settings between Spark 1.6 and Spark 2.

Configuration Settings for Encryption

To enable encryption for the shuffle service with CDS Powered by Apache Spark, use the following configuration setting:

spark.io.encryption.enabled=true

This is a change from Spark 1.6, where the corresponding option is spark.shuffle.encryption.enabled=true.