3.2. Start YARN/MapReduce Services

Optional: If you are using the LinuxContainerExecutor, you must set up container-executor.cfg in the config directory. The file must be owned by root:root. The settings are in the form of key=value with one key per line. There must entries for all keys. If you do not want to assign a value for a key, you can leave it unset in the form of key=#.

The keys are defined as follows:

  • yarn.nodemanager.linux-container-executor.group - the configured value of yarn.nodemanager.linux-container-executor.group. This must match the value of yarn.nodemanager.linux-container-executor.group in yarn-site.xml.

  • banned.users - a comma separated list of users who cannot run container-executor.

  • min.user.id - the minimum value of user id, this is to prevent system users from running container-executor.

  • allowed.system.users - a comma separated list of allowed system users.

To start YARN, run commands as a YARN user. To start MapReduce, run commands as a MapReduce user.

  1. Start the ResourceManager on all your ResourceManager hosts.

    su $YARN_USER
    export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec
    /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh start resourcemanager
    ps -ef | grep -i resourcemanager

  2. Start the NodeManager on all your NodeManager hosts.

    su $YARN_USER
    export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec
    /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh start nodemanager
    ps -ef | grep -i nodemanager
  3. To start MapReduce, run the following commands as MapReduce user:

    su $MAPREDUCE_USER
    export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec
    /usr/lib/hadoop-mapreduce/sbin/mr-jobhistory-daemon.sh --config /etc/hadoop/conf start historyserver
    ps -ef | grep -i jobhistoryserver 

loading table of contents...