Enable System Service Mode
When you upgrade an HDP cluster from 2.6.x to 3.0, the upgraded YARN service includes
HBase installed in the embedded mode. If your cluster meets the capacity requirements for
the HBase component associated with Timeline Service 2.0 to run as a separate
ats-hbase
service, you must enable the system service mode.
-
Configure a separate queue at the root level, say
yarn system
, for theats-hbase
service instead of using the default queue. -
Allocate required resources to the
yarn-system
queue for launching theats-hbase
service.The minimum amount of memory required for launchingats-hbase
is 12 GB.To allocate resources, update the value of theyarn.scheduler.capacity.root.<queue_path>.capacity
property incapacity-scheduler.xml
. The following is an example:yarn.scheduler.capacity.root.yarn-system.capacity=10
-
Set ACLs on the
yarn-system
queue such that theyarn-ats
user can manage theats-hbase
service.To set ACLs on the queue, update values of theyarn.scheduler.capacity.root.<queue-path>.acl_submit_applications
andyarn.scheduler.capacity.root.<queue-path>.acl_administer_queue
incapacity-scheduler.xml
.yarn.scheduler.capacity.root.yarn-system.acl_submit_applications=yarn-ats,yarn yarn.scheduler.capacity.root.yarn-system.acl_administer_queue=yarn-ats,yarn
-
Disable preemption on the
yarn-system
queue.Setyarn.scheduler.capacity.root.<queue-path>.disable_preemption
andyarn.scheduler.capacity.root.<queue-path>.intra-queue-preemption.disable_preemption
incapacity-scheduler.xml
to true.yarn.scheduler.capacity.root.yarn-system.disable_preemption=true yarn.scheduler.capacity.root.yarn-system.intra-queue-preemption.disable_preemption=true
-
Assign the highest priority to the
yarn-system
queue to prevent inadvertent deletion or preemption.Set the value ofyarn.scheduler.capacity.root.<queue-path>.priority
incapacity-scheduler.xml
.yarn.scheduler.capacity.root.yarn-system.priority=<maximum-integer-value>
-
Enable the
is_hbase_system_service_launch
property inyarn-hbase.env
. - Restart YARN.