Setting capacity using mixed resource allocation mode (Technical Preview)
Set the resource allocation in the mixed allocation mode using Cloudera Manager.
- In Cloudera Manager, select the YARN service.
- Go to the Configuration tab.
-
Set the following property in the Capacity Scheduler Configuration Advanced
Configuration Snippet (Safety Valve) field to use the mixed allocation mode:
<property> <name>yarn.scheduler.capacity.legacy-queue-mode.enabled</name> <value>false</value> </property>
-
Specify the capacity for each queue in the preferred allocation mode. Example:
<property> <name>yarn.scheduler.capacity.root.queues</name> <value>default,test_1,test_2</value> </property> <property> <name>yarn.scheduler.capacity.root.capacity</name> <value>100</value> </property> <property> <name>yarn.scheduler.capacity.root.default.capacity</name> <value>[memory=25%, vcores=1w]</value> </property> <property> <name>yarn.scheduler.capacity.root.test_1.capacity</name> <value>[memory=1w, vcores=10%]</value> </property> <property> <name>yarn.scheduler.capacity.root.test_2.capacity</name> <value>[memory=2048, vcores=2w]</value> </property>
- Click Save Changes.
- Click Actions > Restart to restart the service.