Use the HDP Utility script to calculate memory configuration settings. You must update the memory/cpu settings in yarn-site.xml and mapred-site.xml

Paths have changed in . make sure you remove lines from hadoop-env.sh such as:

export JAVA_LIBRARY_PATH=/usr/lib/hadoop/lib/native/Linux-amd64-64

If you leave these paths in your hadoop-env.sh file, the lzo compression code does not load as this is not where lzo is installed.

Use the HDP Utility script to calculate memory configuration settings. You must update the memory/cpu settings in yarn-site.xml and mapred-site.xml

Paths have changed in HDP 2.5. make sure you remove lines from hadoop-env.sh such as:

export JAVA_LIBRARY_PATH=/usr/lib/hadoop/lib/native/Linux-amd64-64

If you leave these paths in your hadoop-env.sh file, the lzo compression code does not load as this is not where lzo is installed.