(Optional) Configuring Dynamic Resource Allocation
The dynamic resource allocation feature allocates resources as you need them and releases them when you do not need them, rather than reserving the resources.
Note | |
---|---|
If you are using the Spark Thrift Server, there is no need to set up dynamic resource allocation. As of HDP 2.4.2, the Spark Thrift Server automatically uses dynamic resource allocation. You can also enable dynamic resource allocation for individual Spark jobs. For more information, see Configuring Dynamic Resource Allocation and Thrift Server Settings in the Spark Guide. |