Upgrade HDP 2.0 Components

« Prev

	Important
	See the HDP Release Notes for the HDP 2.5.5.0 repo information.

The upgrade process to HDP 2.5 involves the following steps.

Select your OS:

RHEL/CentOS/Oracle 6

On all hosts, clean the yum repository.
yum clean all
Remove your old HDP 2.0 components. This command uninstalls the HDP 2.0 components. It leaves the user data, and metadata, but removes your configurations:
yum erase "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "flume*" "accumulo*" "mahout*" "hue" "hue-common" "hue-shell" "hdp_mon_nagios_addons"
Remove your old hdp.repo file:
rm /etc/yum.repos.d/hdp.repo
Install the HDP 2.5 repo:
- Download the hdp.repo file:
  wget -nv http://public-repo-1.hortonworks.com/HDP/centos<version>/2.x/updates/2.5.5.0/hdp.repo -O /etc/yum.repos.d/hdp.repo
- Confirm that the HDP repository is configured.
  yum repolist
  You should see something like this. Verify that you have the HDP-2.5.5.0 directory:
```
Loaded plugins: fastestmirror, security 
Loading mirror speeds from cached hostfile
* base: mirrors.cat.pdx.edu
* extras: linux.mirrors.es.net
* updates: mirrors.usc.edu 
repo id repo namestatus
HDP-2.5.5.0 Hortonworks Data Platform Version - HDP-2.5.5.0 
```

Install the HDP 2.5.5 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.0 components:

yum install "hadoop" "hadoop-hdfs" "hadoop-libhdfs" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hue" "hive" "storm" "flume" "accumulo" "mahout" "kafka" "spark" "slider" "hdp_mon_nagios_addons"

Verify that the components were upgraded.
yum list installed | grep HDP-<old.stack.version.number>
Check to make sure no component file names from the previous stack appear in the returned list.

RHEL/CentOS/Oracle

On all hosts, clean the yum repository.
yum clean all
Remove your old HDP 2.0 components. This command uninstalls the HDP 2.0 components. It leaves the user data, and metadata, but removes your configurations:
yum erase "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "flume*" "accumulo*" "mahout*" "hue" "hue-common" "hue-shell" "hdp_mon_nagios_addons"
Remove your old hdp.repo file:
rm /etc/yum.repos.d/hdp.repo
Install the HDP 2.5 repo:
- Download the hdp.repo file:
  wget -nv http://public-repo-1.hortonworks.com/HDP/centos<version>/2.x/updates/2.5.5.0/hdp.repo -O /etc/yum.repos.d/hdp.repo
- Confirm the HDP repository is configured.
  yum repolist
  You should see something like this. Verify that you have the HDP-2.5.5.0 directory:
```
Loaded plugins: fastestmirror, security 
Loading mirror speeds from cached hostfile
* base: mirrors.cat.pdx.edu
* extras: linux.mirrors.es.net
* updates: mirrors.usc.edu 
repo id repo namestatus
HDP-2.5.5.0 Hortonworks Data Platform Version - HDP-2.5.5.0 
```
Install the HDP 2.5 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components:
yum install "hadoop" "hadooplzo" "webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "flume" "accumulo" "mahout" "hue" "hdp_mon_nagios_addons"
yum install install hive-webhcat webhcat-tar-hive webhcat-tar-pig
Verify that the components were upgraded.
yum list installed | grep HDP-<old.stack.version.number>
No component file names should appear in the returned list.

SLES

On all hosts, clean the yum repository.
zypper clean -all
Remove your old HDP 2.0 components.
zypper rm "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue" "hue-common" "hue-shell" "hdp_mon_nagios_addons"
Remove your old hdp.repo file:
rm /etc/zypp/repos.d/hdp.repo
Install the HDP 2.5 repo:
- Download the hdp.repo file:
  wget -nv http://public-repo-1.hortonworks.com/HDP/sles11sp1/2.x/updates/2.5.5.0/hdp.repo -O /etc/zypp/repos.d/hdp.repo
Install the HDP 2.5 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.0 components:
zypper install "hadoop" "hadooplzo" "webhcat" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "flume" "accumulo" "mahout" "hue" "hdp_mon_nagios_addons"
zypper install hive-webhcat webhcat-tar-hive webhcat-tar-pig
zypper up -r HDP-2.5.5.0
zypper install oozie-client
Verify that the components were upgraded. For example, to verify hdfs, hive, and hcatlog:
rpm -qa | grep hdfs, && rpm -qa | grep hive && rpm -qa | grep hcatalog
No component files names should appear in the returned list.

SLES

On all hosts, clean the yum repository.
zypper clean -all
Remove your old HDP 2.0 components.
zypper rm "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "flume*" "accumulo*" "mahout*" "hue" "hue-common" "hue-shell" "hdp_mon_nagios_addons"
Remove your old hdp.repo file:
rm /etc/zypp/repos.d/hdp.list
Install the HDP 2.5 repo:
- Download the hdp.repo file:
  http://public-repo-1.hortonworks.com/HDP/suse11sp3/2.x/updates/2.5.5.0/hdp.repo -O /etc/zypp/repos.d/hdp.repo
Install the HDP 2.5 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.0 components:
zypper install "hadoop" "hadooplzo" "webhcat" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "flume" "accumulo" "mahout" "hue" "knox" "hdp_mon_nagios_addons"
zypper install hive-webhcat webhcat-tar-hive webhcat-tar-pig
zypper up -r HDP-2.5.5.0
zypper install oozie-client
Verify that the components were upgraded. For example, to verify hdfs, hive, and hcatlog:
rpm -qa | grep hdfs, && rpm -qa | grep hive && rpm -qa | grep hcatalog
No component files names should appear in the returned list.

Ubuntu 12

On all hosts, clean the apt-get repository.
apt-get clean -&-all
Remove your old HDP 2.0 components.
apt-get remove "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "flume*" "accumulo*" "mahout*" "hue.*" "hdp_mon_nagios_addons" --purge
Remove your old hdp.repo file:
rm /etc/apt/sources.list.d/hdp.list
Install the HDP 2.5 repo:
- Download the hdp.repo file:
  wget http://public-repo-1.hortonworks.com/HDP/ubuntu12/2.x/updates/2.5.5.0/hdp.list -O /etc/apt/sources.list.d/hdp.list
Run an update:
apt-get update
Install the HDP 2.5 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.0 components:
apt-get install "hadoop" "hadooplzo" "webhcat" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "flume" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"
apt-get install hive-webhcat webhcat-tar-hive webhcat-tar-pig

Debian

On all hosts, clean the apt-get repository.
apt-get clean all
Remove your old HDP 2.0 components. This command uninstalls the HDP 2.0 components. It leaves the user data, and metadata, but removes your configurations:
apt-get remove "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "flume*" "mahout*" "hue*"
Remove your old hdp.repo file:
rm /etc/apt/sources.list.d/hdp.list
Install the HDP 2.5 repo:
- Download the hdp.repo file:
  wget http://public-repo-1.hortonworks.com/HDP/debian<version>/2.x/updates/2.5.5.0/hdp.list -O /etc/apt/sources.list.d/hdp.list
Run an update:
```
apt-get update
```
Install the HDP 2.5 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.0 components:
apt-get install "hadoop" "hadooplzo" "webhcat" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "flume" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"
apt-get install hive-webhcat webhcat-tar-hive webhcat-tar-pig

​Upgrade HDP 2.0 Components