DocsHortonworks Data Platform

 

 2. Upgrade HDP 2.1 Components

The upgrade process to HDP 2.2 involves the following steps. Select your OS:

RHEL/CentOS/Oracle 6

  1. On all hosts, clean the yum repository.

    yum clean all

  2. Remove your old HDP 2.1 components. This command uninstalls the HDP 2.1 components. It leaves the user data, and metadata, but removes your configurations: 

    yum erase "hadoop*" "webhcat*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "tez*" "storm*" "falcon*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue" "hue-common" "hue-shell" "knox*" "hdp_mon_nagios_addons"

  3. Remove your old hdp.repo file:

    rm /etc/yum.repos.d/hdp.repo

  4. Install the HDP 2.2 repo:

    • Download the hdp.repo file:

      wget -nv http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.2.8.0/hdp.repo -O /etc/yum.repos.d/hdp.repo

    • Confirm the HDP repository is configured.

      yum repolist

      You should see something like this. Verify that you have the HDP-2.2.8.0 directory:

      Loaded plugins: fastestmirror, security 
Loading mirror speeds from cached hostfile
* base: mirrors.cat.pdx.edu
* extras: linux.mirrors.es.net
* updates: mirrors.usc.edu 
repo id repo namestatus
HDP-2.2.8.0 Hortonworks Data Platform Version - HDP-2.2.8.0

  5. Install the HDP 2.2 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components: 

    yum install "hadoop" "hadoop-hdfs" "hadoop-libhdfs" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hue" "hive" "tez" "storm" "falcon" "flume" "phoenix" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"
    [Note]Note

    If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

  6. Verify that the components were upgraded.

    yum list installed | grep HDP-<old.stack.version.number>

    No component file names should appear in the returned list.

RHEL/CentOS/Oracle 5 (Deprecated)

  1. On all hosts, clean the yum repository.

    yum clean all

  2. Remove your old HDP 2.1 components. This command uninstalls the HDP 2.1 components. It leaves the user data, and metadata, but removes your configurations:

    yum erase "hadoop*" "webhcat*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "tez*" "storm*" "falcon*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue" "hue-common" "hue-shell" "knox*" "hdp_mon_nagios_addons"

  3. Remove your old hdp.repo file:

    rm /etc/yum.repos.d/hdp.repo

  4. Install the HDP 2.2 repo:

    • Download the hdp.repo file:

      wget -nv http://public-repo-1.hortonworks.com/HDP/centos5/2.x/updates/2.2.8.0/hdp.repo -O /etc/yum.repos.d/hdp.repo

    • Confirm the HDP repository is configured.

      yum repolist

      You should see something like this. Verify that you have the HDP-2.2.8.0 directory:

      Loaded plugins: fastestmirror, security 
Loading mirror speeds from cached hostfile
* base: mirrors.cat.pdx.edu
* extras: linux.mirrors.es.net
* updates: mirrors.usc.edu 
repo id repo namestatus
HDP-2.2.8.0 Hortonworks Data Platform Version - HDP-2.2.8.0

  5. Install the HDP 2.2 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components:

    yum install "hadoop" "hadoop-hdfs" "hadoop-libhdfs" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "hue" "tez" "storm" "falcon" "flume" "phoenix" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"
    [Note]Note

    If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

  6. Verify that the components were upgraded.

    yum list installed | grep HDP-<old.stack.version.number>

    No component file names should appear in the returned list.

SLES 11 SP 1

  1. On all hosts, clean the yum repository.

    zypper clean all

  2. Remove your old HDP 2.1 components. This command uninstalls the HDP 2.1 components. It leaves the user data, and metadata, but removes your configurations:

    zypper rm "hadoop*" "webhcat*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "tez*" "storm*" "falcon*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue" "hue-common" "hue-shell" "knox*" "hdp_mon_nagios_addons"

  3. Remove your old hdp.repo file:

    rm /etc/zypp/repos.d/hdp.repo

  4. Download the HDP 2.2 hdp.repo file:

    wget -nv http://public-repo-1.hortonworks.com/HDP/sles11sp1/2.x/updates/2.2.8.0/hdp.repo -O /etc/zypp/repos.d/hdp.repo

  5. Install the HDP 2.2 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components:

    zypper install "hadoop" "hadoop-hdfs" "hadoop-libhdfs" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "hue" "tez" "storm" "falcon" "flume" "phoenix" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"

    zypper install webhcat-tar-hive webhcat-tar-pig

    zypper up -r HDP-2.2.8.0

    zypper install oozie-client

    [Note]Note

    If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

  6. Verify that the components were upgraded. For example, to verify hdfs, hive, and hcatlog:

    rpm -qa | grep hdfs, && rpm -qa | grep hive && rpm -qa | grep hcatalog

    No component files names should appear in the returned list.

SLES 11 SP3/SP4

  1. On all hosts, clean the yum repository.

    zypper clean all

  2. Remove your old HDP 2.1 components.

    zypper rm "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "tez*" "storm*" "falcon*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue" "hue-common" "hue-shell" "knox*" "hdp_mon_nagios_addons"

  3. Remove your old hdp.repo file:

    rm /etc/zypp/repos.d/hdp.list

  4. Download the HDP 2.2 hdp.repo file:

    http://public-repo-1.hortonworks.com/HDP/suse11sp3/2.x/updates/2.2.8.0/hdp.repo -O /etc/zypp/repos.d/hdp.repo

  5. Install the HDP 2.2 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components:

    zypper install "hadoop" "hadoop-hdfs" "hadoop-libhdfs" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hue" "hive" "tez" "storm" "falcon" "flume" "phoenix" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"

    zypper install webhcat-tar-hive webhcat-tar-pig

    zypper up -r HDP-2.2.8.0

    zypper install oozie-clientt

    [Note]Note

    If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

  6. Verify that the components were upgraded. For example, to verify hdfs, hive, and hcatalog:

    rpm -qa | grep hdfs, && rpm -qa | grep hive && rpm -qa | grep hcatalog

    No component files names should appear in the returned list.

Ubuntu 12

  1. On all hosts, clean the apt-get repository.

    apt-get clean all

  2. Remove your old HDP 2.1 components. This command uninstalls the HDP 2.1 components. It leaves the user data, and metadata, but removes your configurations:

    apt-get remove "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "tez.*" "storm*" "falcon*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue.*" "knox*" "hdp_mon_nagios_addons" --purge

  3. Remove your old hdp.repo file:

    rm /etc/apt/sources.list.d/hdp.list

  4. Download the HDP 2.2 hdp.repo file:

    wget http://public-repo-1.hortonworks.com/HDP/ubuntu12/2.x/updates/2.2.8.0/hdp.list -O /etc/apt/sources.list.d/hdp.list

  5. Run an update:

    apt-get update

  6. Install the HDP 2.2 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components:

    apt-get install "hadoop" "hadoop-hdfs" "libhdfs0" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "tez" "storm" "falcon" "flume" "phoenix" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"
    [Note]Note

    If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

Debian 6

  1. On all hosts, clean the apt-get repository.

    apt-get clean all

  2. Remove your old HDP 2.1 components. This command uninstalls the HDP 2.1 components. It leaves the user data, and metadata, but removes your configurations: 

    apt-get remove "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "tez*" "storm*" "falcon*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue*" "knox*" "hdp_mon_nagios_addons"

  3. Remove your old hdp.repo file:

    rm /etc/apt/sources.list.d/hdp.list

  4. Download the HDP 2.2 hdp.repo file:

    wget -nv http://public-repo-1.hortonworks.com/HDP/debian6/2.x/updates/2.2.8.0/hdp.list -O /etc/apt/sources.list.d/hdp.list

  5. Run an update:

    apt-get update

  6. Install the HDP 2.2 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components:

    apt-get install "hadoop" "hadoop-hdfs" "libhdfs0" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "tez" "storm" "falcon" "flume" "phoenix" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"
    [Note]Note

    If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

Legal notices
loading table of contents...