Optional: If you are using the
LinuxContainerExecutor
, you must set up
container-executor.cfg
in the config
directory. The file must be owned by root:root
. The settings are
in the form of key=value
with one key per line. There must
entries for all keys. If you do not want to assign a value for a key, you can leave
it unset in the form of key=#
.
The keys are defined as follows:
yarn.nodemanager.linux-container-executor.group
- the configured value ofyarn.nodemanager.linux-container-executor.group
. This must match the value ofyarn.nodemanager.linux-container-executor.group
inyarn-site.xml
.banned.users
- a comma separated list of users who cannot runcontainer-executor
.min.user.id
- the minimum value of user id, this is to prevent system users from runningcontainer-executor
.allowed.system.users
- a comma separated list of allowed system users.
To start YARN, run commands as a YARN user. To start MapReduce, run commands as a MapReduce user.
Start the ResourceManager on all your ResourceManager hosts.
su $YARN_USER export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh start resourcemanager ps -ef | grep -i resourcemanager
Start the NodeManager on all your NodeManager hosts.
su $YARN_USER export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh start nodemanager ps -ef | grep -i nodemanager
To start MapReduce, run the following commands as MapReduce user:
su $MAPREDUCE_USER export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec /usr/lib/hadoop-mapreduce/sbin/mr-jobhistory-daemon.sh --config /etc/hadoop/conf start historyserver ps -ef | grep -i jobhistoryserver