On all nodes, clean the yum repository.
For RHEL/CentOS:
yum clean all
For SLES:
zypper clean --all
For Ubuntu:
apt-get clean all
Use the HDP Utility script to calculate memory configuration settings.
Upgrade Hadoop
For RHEL/CentOS/Oracle Linux:
yum upgrade hadoop*
For SLES:
zypper install hadoop* hadoop-hdfs hadoop-lzo hadoop-mapreduce hadoop-yarn
For Ubuntu:
apt-get update apt-get install hadoop hadoop-hdfs libhdfs0 libhdfs0-dev hadoop-yarn hadoop-mapreduce hadoop-client opensslliblzo2-2 liblzo2-dev hadoop-lzo hadoop-mapreduce hadoop-yarn
Verify HDP 2.1 packages have installed successfully.
For RHEL/CentOS/Oracle Linux:
yum list hadoop*|grep HDP-2
For SLES:
zypper pa|grep HDP-2
Verify that you have HDP 2.1 installed:
hadoop version
You may need to add
/etc/hadoop/conf/hadoop-env.sh
in/usr/bin/hadoop
for $JAVA_HOME.For Ubuntu:
dpkg -s HDP-2 | grep Status