Cloudera Docs

Configuring Node Attribute for Application Master Placement [Technical Preview]

Use the Node Attribute property to describe the attributes of a Node. The placement preference assigns nodes as worker nodes or compute nodes using the Node Attribute property. Application Master (AM) container is placed to run on worker nodes instead of compute nodes. The worker group is more stable because YARN ResourceManager and HDFS NameNode run in it. Also, the worker group nodes are less likely to be shut down due to autoscaling.

Technical Preview: This is a technical preview feature and considered under development. Do not use this in your production systems. To share your feedback, contact Support by logging a case on our Cloudera Support Portal. Technical preview features are not guaranteed troubleshooting guidance and fixes.

By default, a script runs to tag nodes as worker nodes or compute nodes using the node attribute mapping rule. AM containers are placed to run on worker nodes instead of compute nodes. You can disable the script to not make a placement preference for running AM containers.

  1. In Cloudera Manager, click Clusters > YARN.
  2. Go to the Configuration tab.
  3. Search for nm yarn-site.xml.
  4. Set the below property using advanced configuration snippet (safety-valve). 
    Name: yarn.nodemanager.node-attributes.provider 
Value: config
  5. Click Save.
  6. Click Actions and select Restart to restart the service.