Enable Priority Scheduling
You can use Priority Scheduling to run YARN applications at higher priority, regardless of other applications that are already running in the cluster. YARN allocates more resources to applications running at a higher priority over those running at a lower priority. Priority Scheduling enables you to set an application's priority both at the time of submission and dynamically at run time.
Set the cluster maximum and leaf-queue level priorities.
Cluster maximum priority: Set the following property in the
yarn-site.xmlfile to define the maximum priority for an application in the cluster:
Any application submitted with a priority greater than this setting has its priority reset to the
Leaf queue-level priority: Set the following property in the
capacity-scheduler.xmlfile to define the default application priority in a leaf queue:
Use either the
yarn application -appIDcommand-line option or the Cluster Application REST API to set the priority for already running applications.
yarn application -appID<appID>
- Cluster Application Priority API