Execute these commands from the JobHistory server to set up directories on HDFS :
su $HDFS_USER /usr/lib/hadoop/sbin/hadoop fs -mkdir -p /mapred/history/done_intermediate /usr/lib/hadoop/sbin/hadoop fs -chmod -R 1777 /mapred/history/done_intermediate /usr/lib/hadoop/sbin/hadoop fs -mkdir -p /mapred/history/done /usr/lib/hadoop/sbin/hadoop fs -chmod -R 1777 /mapred/history/done /usr/lib/hadoop/sbin/hadoop fs -chown -R mapred /mapred
Execute these commands from the JobHistory server:
export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec/ export HADOOP_MAPRED_HOME=/usr/lib/hadoop-mapreduce export HADOOP_MAPRED_LOG_DIR=/var/log/hadoop/mapred
<login as $MAPRED_USER and source the directories.sh companion script> /usr/lib/hadoop-mapreduce/sbin/mr-jobhistory-daemon.sh start historyserver --config $HADOOP_CONF_DIR
where:
$HDFS_USER
is the user owning the HDFS services. For example,hdfs
.$MAPRED_USER
is the user owning the MapRed services. For example,mapred
.$HADOOP_CONF_DIR
is the directory for storing the Hadoop configuration files. For example,/etc/hadoop/conf
.