Cloudera Docs

Configuring Spark Environment Variables Using Cloudera Manager

Configure service-wide environment variables for all Spark applications in spark-env.sh as follows.

  1. Go to the Cloudera Manager Admin Console.
  2. Navigate to the Spark 2 service.
  3. Click the Configuration tab.
  4. Search for the Spark Service Advanced Configuration Snippet (Safety Valve) for spark-conf/spark-env.sh property and add the paths for the environment variables you want to configure.
  5. Click Save Changes to commit the changes.
  6. Restart the service.
  7. Deploy the client configuration.
  8. Restart Cloudera Data Science Workbench.