Create a Resource Pool
You can create resource pools in addition to the default root.default resource pool.
There is always a resource pool named root.default. By default, all YARN applications run in this pool. You create additional pools when your workload includes identifiable groups of applications (such as from a particular application, or a particular group within your organization) that have their own requirements.
- In Cloudera Manager, click Clusters.
- Select the Cluster Name.
Click Dynamic Resource Pool Configuration.
If the cluster has a YARN service, the YARN / Resource Pool tab displays. If the cluster has an Impala service enabled, the Impala Admission Control / Resource Pool tab displays.
- Click the YARN tab.
Click Create Resource Pool.
The Create Resource Pool dialog box displays, showing the Resource Limits tab.
Specify the name and resource limits for the pool:
- In the Resource Pool Name field, specify a unique pool name containing only alphanumeric characters. If referencing a user or group name that contains a ".", replace the "." with "_dot_".
- To make the pool a parent pool, select the Parent Pool checkbox.
- Define a configuration set by assigning values to the listed properties. Specify a weight that indicates that pool's share of resources relative to other pools, minimum and maximum for virtual cores and memory, and a limit on the number of applications that can run simultaneously in the pool. If this is a parent pool, you can also set the maximum resources for undeclared children.
- Click the Scheduling Policy tab and select a
- Dominant Resource Fairness (DRF) (default) - An extension of fair scheduling for more than one resource. DRF determines CPU and memory resource shares based on the availability of those resources and the job requirements.
- Fair (FAIR) - Determines resource shared based on memory.
- First-In, First-Out (FIFO)- Detemines resource shared based on when a job was added.
- If you have enabled Fair Scheduler preemption, click the Preemption tab and optionally set a preemption timeout to specify how long a job in this pool must wait before it can preempt resources from jobs in other pools.
- IIf you have enabled ACLs and specified users or groups, optionally click the Submission and Administration Access Control tabs to specify which users and groups can submit applications and which users can view all and kill applications. By default, anyone can submit, view all, and kill applications. To restrict these permissions, select Allow these users and groups and provide a comma-delimited list of users and groups in the Users and Groups fields respectively.
- Click Create.
- Click Refresh Dynamic Resource Pools.