4. Configure MapReduce on HDFS

To use MapReduce, create the MapReduce history folder, tmp directory, application logs, and a YARN folder in HDFS. Then set folder permissions:

%HADOOP_HOME%\bin\hdfs dfs -mkdir -p /mapred/history/done/mapred/history/done_intermediate 
%HADOOP_HOME%\bin\hdfs dfs -chmod -R 1777 /mapred/history/done_intermediate 
%HADOOP_HOME%\bin\hdfs dfs -chmod 770/mapred/history/done 
%HADOOP_HOME%\bin\hdfs dfs -chown -R hadoop:hadoopUsers /mapred 
%HADOOP_HOME%\bin\hdfs dfs -chmod 755 /mapred /mapred/history 
%HADOOP_HOME%\bin\hdfs dfs -mkdir /tmp 
%HADOOP_HOME%\bin\hdfs dfs -chmod 777 /tmp 
%HADOOP_HOME%\bin\hdfs dfs -mkdir /app-logs 
%HADOOP_HOME%\bin\hdfs dfs -chown hadoop:hadoopUsers /app-logs
%HADOOP_HOME%\bin\hdfs dfs -chmod 1777 /app-logs 
%HADOOP_HOME%\bin\hdfs dfs -mkdir -p /yarn /yarn/generic-history/ 
%HADOOP_HOME%\bin\hdfs dfs -chmod -R 700 /yarn
%HADOOP_HOME%\bin\hdfs dfs -chown -R hadoop:hadoop /yarn  
          


loading table of contents...