Cloudera Docs

Configure Queue Preemption

Capacity Scheduler Preemption allows higher-priority applications to preempt lower-priority applications.

A scenario can occur in which a queue has a guaranteed level of cluster resources, but must wait to run applications because other queues are utilizing all of the available resources. If Preemption is enabled, higher-priority applications do not have to wait because lower priority applications have taken up the available capacity. With Preemption enabled, under-served queues can begin to claim their allocated cluster resources almost immediately, without having to wait for other queues' applications to finish running.

To configure Queue Preemption (yarn.resourcemanager.scheduler.monitor.enable) on all queues, perform the following:

  1. In Cloudera Manager, select Clusters > YARN Queue Manager UI service. A list of existing queues is displayed.
  2. Click on the Scheduler Configuration tab.
  3. Select the Enable Queue Preemption checkbox.
  4. Click Save.

    For information about configuring preemption for a specific queue, see Configure preemption for a specific queue.