Managing and Allocating Cluster Resources using Apache Hadoop YARN
Cluster Management with Capacity Scheduler
Using scheduling to allocate resources
YARN resource allocation
Use CPU scheduling
Configure CPU scheduling and isolation
Limit CPU usage with Cgroups
Enable Cgroups
Using Cgroups
Partition a cluster using node labels
Configure node labels
Use node labels
Allocating Resources with Capacity Scheduler
Capacity Scheduler Overview
Enable the Capacity Scheduler
Set up queues
Hierarchical Queue Characteristics
Scheduling Among Queues
Control access to queues with ACLs
Define queue mapping policies
Configure queue mapping for users and groups to specific queues
Configure queue mapping for users and groups to queues with the same name
Configure queue mapping to use the user name from the application tag
Enable override of default queue mappings
Manage cluster capacity with queues
Set queue priorities
Resource distribution workflow
Resource distribution workflow example
Set user limits
Application reservations
Set flexible scheduling policies
Examples of FIFO and Fair Sharing policies
Configure queue ordering policies
Best practices for ordering policies
Start and stop queues
Set application limits
Enable preemption
Preemption workflow
Configure preemption
Enable priority scheduling
Configure ACLs for application priorities
Enable intra-queue preemption
Properties for configuring intra-queue preemption
Intra-Queue preemption based on application priorities
Intra-Queue preemption based on user limits