Managing and Allocating Cluster Resources using Capacity Scheduler
Cluster Management with Capacity Scheduler
Using scheduling to allocate resources
YARN resource allocation
Use CPU scheduling
Configure CPU scheduling and isolation
Configure GPU scheduling and isolation
Options to run distributed shell and GPU
Limit CPU usage with Cgroups
Enable Cgroups
Using Cgroups
Partition a cluster using node labels
Configure node labels
Use node labels
Allocating Resources using YARN Queue Manager UI
Prerequisite
Set up Queues
Add queues using YARN Queue Manager UI
Hierarchical queue characteristics
Scheduling Among Queues
Configure Scheduler Properties
Define Queue Mapping Policies
Configure queue mapping for users and groups to specific queues
Configure Queue Mapping for Users and Groups to Queues with the Same Name
Enable override of default queue mappings
Configure queue mapping to use the user name from the application tag using Cloudera Manager
Set Application Priority
Configure Queue Preemption
Configure Intra-Queue Preemption
Set Application Limits
Set Application Master Resource Limit
Configure Asynchronous Scheduler
Configuring Cluster Capacity with Queues
Configure Queue Properties
Set User Limits
Set application limit for a specific queue
Set Application Master resource limit for a specific queue
Control access to queues using ACLs
Configure preemption for a specific queue
Configure Intra-Queue Preemption for a specific queue
Set Flexible Scheduling Policies
Examples FIFO and Fair Sharing Policies
Configure Queue Ordering Policies
Best Practices for Ordering Policies
Associate Node Labels with Queues
Application Reservations
Resource Distribution Workflow
Resource Distribution Process - Example
Start and Stop Queues
Delete Queues