2. Upgrade Hadoop

  1. Download the HDP 2.1 rusing a local repository or a remote repository.

  2. On all nodes, clean the yum repository.

    • For RHEL/CentOS:

      yum clean all 
    • For SLES:

      zypper clean -a
    • For Ubuntu or Debian:

      apt-get clean all

  3. Use the HDP Utility script to calculate memory configuration settings.

  4. Upgrade Hadoop

    • For RHEL/CentOS/Oracle Linux:

      yum upgrade hadoop*

    • For SLES:

      zypper up hadoop* hadoop-hdfs hadoop-lzo hadoop-mapreduce hadoop-yarn
    • For Ubuntu or Debian:

      apt-get update
      apt-get install hadoop hadoop-hdfs libhdfs0 libhdfs0-dev hadoop-yarn hadoop-mapreduce hadoop-client opensslliblzo2-2 liblzo2-dev hadoop-lzo hadoop-mapreduce hadoop-yarn
  5. Verify HDP 2.1 packages have installed successfully.

    • For RHEL/CentOS/Oracle Linux:

      yum list hadoop*|grep HDP-2 

    • For SLES:

      zypper pa|grep HDP-2 

      Verify that you have HDP 2.1 installed:

      hadoop version

      You may need to add /etc/hadoop/conf/hadoop-env.sh in /usr/bin/hadoop for $JAVA_HOME.

    • For Ubuntu or Debian:

      dpkg -s HDP-2 | grep Status 

loading table of contents...