Cloudera Docs

Configuring Global Properties Using Cloudera Manager

Configure client configuration properties for all Spark applications in spark-defaults.conf as follows.

  1. Go to the Cloudera Manager Admin Console.
  2. Navigate to the Spark service.
  3. Click the Configuration tab.
  4. Search for the Spark Client Advanced Configuration Snippet (Safety Valve) for spark-conf/spark-defaults.conf property.
  5. Specify properties described in Application Properties. If more than one role group applies to this configuration, edit the value for the appropriate role group.
  6. Click Save Changes to commit the changes.
  7. Deploy the client configuration.
  8. Restart Cloudera Data Science Workbench.

For more information on using a spark-defaults.conf file for Spark jobs, visit the Apache Spark 2 reference documentation.