Cloudera Docs

Customize dynamic resource allocation settings

Use the following steps to review and customize dynamic resource allocation settings.

Dynamic resource allocation requires an external shuffle service that runs on each worker node as an auxiliary service of NodeManager. This service is started automatically; no further steps are needed.

Dynamic resource allocation is enabled by default. To modify dynamic allocation settings, use the following procedure.

  1. From the Cloudera Data Platform (CDP) interface, click through to Cloudera Manager for the cluster running Spark.
  2. Go to the Spark service page (Clusters > Spark service).
  3. Click on the Configuration tab.
  4. In the Search box, enter dynamicAllocation.
  5. After making the changes you want, enter the reason for the change in the Reason for change... box, and then click Save Changes.
  6. Restart the Spark service (Spark service > Actions > Restart).