3. Configure MapReduce on HDFS

To use MapReduce, create the MapReduce history folder, tmp directory, application logs, and a YARN folder in HDFS. Then set folder permissions:

%HADOOP_HOME%\bin\hdfs dfs -mkdir -p /mapred/history/done
/mapred/history/done_intermediate %HADOOP_HOME%\bin\hdfs dfs -chmod -R 1777
/mapred/history/done_intermediate %HADOOP_HOME%\bin\hdfs dfs -chmod 770
/mapred/history/done %HADOOP_HOME%\bin\hdfs dfs -chown -R hadoop:hadoopUsers 
/mapred %HADOOP_HOME%\bin\hdfs dfs -chmod 755 /mapred /mapred/history %HADOOP_HOME%\bin\hdfs dfs
-mkdir /tmp %HADOOP_HOME%\bin\hdfs dfs -chmod 777 /tmp %HADOOP_HOME%\bin\hdfs dfs -mkdir
/app-logs %HADOOP_HOME%\bin\hdfs dfs -chown hadoop:hadoopUsers /app-logs
%HADOOP_HOME%\bin\hdfs dfs -chmod 1777 /app-logs %HADOOP_HOME%\bin\hdfs dfs -mkdir -p
/yarn /yarn/generic-history/ %HADOOP_HOME%\bin\hdfs dfs -chmod -R 700 /yarn
%HADOOP_HOME%\bin\hdfs dfs -chown -R hadoop:hadoop /yarn  
          


loading table of contents...