2. Upgrade Hadoop

  1. On all nodes, clean the yum repository.

    • For RHEL/CentOS:

      yum clean all 
    • For SLES:

      zypper clean --all
    • For Ubuntu:

      apt-get clean all

  2. Use the HDP Utility script to calculate memory configuration settings.

  3. Upgrade Hadoop

    • For RHEL/CentOS/Oracle Linux:

      yum upgrade hadoop*

    • For SLES:

      zypper install hadoop* hadoop-hdfs hadoop-lzo hadoop-mapreduce hadoop-yarn
    • For Ubuntu:

      apt-get update
      apt-get install hadoop hadoop-hdfs libhdfs0 libhdfs0-dev hadoop-yarn hadoop-mapreduce hadoop-client opensslliblzo2-2 liblzo2-dev hadoop-lzo hadoop-mapreduce hadoop-yarn
  4. Verify HDP 2.1 packages have installed successfully.

    • For RHEL/CentOS/Oracle Linux:

      yum list hadoop*|grep HDP-2 

    • For SLES:

      zypper pa|grep HDP-2 

      Verify that you have HDP 2.1 installed:

      hadoop version

      You may need to add /etc/hadoop/conf/hadoop-env.sh in /usr/bin/hadoop for $JAVA_HOME.

    • For Ubuntu:

       dpkg -s HDP-2 | grep Status 

loading table of contents...