Upgrade HDP 2.1 Components

The upgrade process to HDP-2.4.0 involves the following steps. See the HDP-2.4.0 Release Notes for repo information.

RHEL/CentOS/Oracle 6

On all hosts, clean the yum repository.
yum clean all

Remove your old HDP 2.1 components. This command uninstalls the HDP 2.1 components. It leaves the user data, and metadata, but removes your configurations:

yum erase "hadoop*" "webhcat*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "tez*" "storm*" "falcon*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue" "hue-common" "hue-shell" "knox*" "hdp_mon_nagios_addons"

Validate that all HDP 2.1 component binaries are uninstalled:
yum list installed | grep @HDP2.1
Remove your old hdp.repo file:
rm /etc/yum.repos.d/hdp.repo

Install the HDP-2.4.0 repo:

Download the hdp.repo file:

wget -nv http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.4.0.0/hdp.repo -O /etc/yum.repos.d/hdp.repo

Confirm the HDP repository is configured.

yum repolist

You should see something like this. Verify that you have the HDP-2.4.0 directory:

Loaded plugins: fastestmirror, security 
Loading mirror speeds from cached hostfile
* base: mirrors.cat.pdx.edu
* extras: linux.mirrors.es.net
* updates: mirrors.usc.edu 
repo id repo namestatus
HDP-2.4.0 Hortonworks Data Platform Version - HDP-2.4.0

Install the HDP-2.4.0 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components:
Important
For Falcon, we recommend upgrading from HDP 2.1 to HDP 2.2 and then upgrading HDP 2.2 to HDP 2.4. See Configure and Validate Falcon for more information.
```
yum install "hadoop" "hadoop-hdfs" "hadoop-libhdfs" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "hive-webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hue" "hive" "tez" "storm" "flume" "phoenix" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"
```
Note
If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.
Verify that the components were upgraded.
yum list installed | grep HDP-<old.stack.version.number>
No component file names should appear in the returned list.

	Important
For Falcon, we recommend upgrading from HDP 2.1 to HDP 2.2 and then upgrading HDP 2.2 to HDP 2.4. See Configure and Validate Falcon for more information.

	Note
If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

RHEL/CentOS/Oracle 5 (Deprecated)

On all hosts, clean the yum repository.
yum clean all

Remove your old HDP 2.1 components. This command uninstalls the HDP 2.1 components. It leaves the user data, and metadata, but removes your configurations:

yum erase "hadoop*" "webhcat*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "tez*" "storm*" "falcon*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue" "hue-common" "hue-shell" "knox*" "hdp_mon_nagios_addons"

Validate that all HDP 2.1 component binaries are uninstalled:
yum list installed | grep @HDP2.1
Remove your old hdp.repo file:
rm /etc/yum.repos.d/hdp.repo

Install the HDP-2.4.0 repo:

Download the hdp.repo file:

wget -nv http://public-repo-1.hortonworks.com/HDP/centos5/2.x/updates/2.4.0.0/hdp.repo -O /etc/yum.repos.d/hdp.repo

Confirm the HDP repository is configured.

yum repolist

You should see something like this. Verify that you have the HDP-2.4.0 directory:

Loaded plugins: fastestmirror, security 
Loading mirror speeds from cached hostfile
* base: mirrors.cat.pdx.edu
* extras: linux.mirrors.es.net
* updates: mirrors.usc.edu 
repo id repo namestatus
HDP-2.4.0 Hortonworks Data Platform Version - HDP-2.4.0

Install the HDP-2.4.0 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components:
Important
For Falcon, we recommend upgrading from HDP 2.1 to HDP 2.2 and then upgrading HDP 2.2 to HDP 2.4. See Configure and Validate Falcon for more information.
```
yum install "hadoop" "hadoop-hdfs" "hadoop-libhdfs" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "hive-webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "hue" "tez" "storm" "flume" "phoenix" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"
```
Note
If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.
Verify that the components were upgraded.
yum list installed | grep HDP-<old.stack.version.number>
No component file names should appear in the returned list.

	Important
For Falcon, we recommend upgrading from HDP 2.1 to HDP 2.2 and then upgrading HDP 2.2 to HDP 2.4. See Configure and Validate Falcon for more information.

	Note
If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

SLES 11 SP 1

On all hosts, clean the yum repository.
zypper clean -all

Remove your old HDP 2.1 components. This command uninstalls the HDP 2.1 components. It leaves the user data, and metadata, but removes your configurations:

zypper rm "hadoop*" "webhcat*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "tez*" "storm*" "falcon*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue" "hue-common" "hue-shell" "knox*" "hdp_mon_nagios_addons"

Validate that all HDP 2.1 component binaries are uninstalled:
yum list installed | grep @HDP2.1
Remove your old hdp.repo file:
rm /etc/zypp/repos.d/hdp.repo

Download the HDP-2.4.0 hdp.repo file:

wget -nv http://public-repo-1.hortonworks.com/HDP/sles11sp1/2.x/updates/2.4.0.0/hdp.repo -O /etc/zypp/repos.d/hdp.repo

Install the HDP-2.4.0 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components:
Important
For Falcon, we recommend upgrading from HDP 2.1 to HDP 2.2 and then upgrading HDP 2.2 to HDP 2.4. See Configure and Validate Falcon for more information.
```
zypper install "hadoop" "hadoop-hdfs" "hadoop-libhdfs" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "hive-webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "hue" "tez" "storm" "flume" "phoenix" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"
```
zypper install webhcat-tar-hive webhcat-tar-pig
zypper up -r HDP-2.3
zypper install oozie-client
Note
If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.
Verify that the components were upgraded. For example, to verify hdfs, hive, and hcatlog:
rpm -qa | grep hdfs, && rpm -qa | grep hive && rpm -qa | grep hcatalog
No component files names should appear in the returned list.

	Important
For Falcon, we recommend upgrading from HDP 2.1 to HDP 2.2 and then upgrading HDP 2.2 to HDP 2.4. See Configure and Validate Falcon for more information.

	Note
If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

SLES 11 SP3/SP4

On all hosts, clean the yum repository.
zypper clean -all

Remove your old HDP 2.1 components.

zypper rm "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "tez*" "storm*" "falcon*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue" "hue-common" "hue-shell" "knox*" "hdp_mon_nagios_addons"

Validate that all HDP 2.1 component binaries are uninstalled:
zypper search -i | grep @HDP2.1
Remove your old hdp.repo file:
rm /etc/zypp/repos.d/hdp.list
Download the HDP-2.4.0 hdp.repo file:
wget http://public-repo-1.hortonworks.com/HDP/suse11sp3/2.x/updates/2.4.0.0/hdp.repo -O /etc/zypp/repos.d/hdp.repo
Install the HDP-2.4.0 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components:
Important
For Falcon, we recommend upgrading from HDP 2.1 to HDP 2.2 and then upgrading HDP 2.2 to HDP 2.4. See Configure and Validate Falcon for more information.
```
zypper install "hadoop" "hadoop-hdfs" "hadoop-libhdfs" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "hive-webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hue" "hive" "tez" "storm" "flume" "phoenix" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"
```
zypper install webhcat-tar-hive webhcat-tar-pig
zypper up -r HDP-2.3
zypper install oozie-client
Note
If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.
Verify that the components were upgraded. For example, to verify hdfs, hive, and hcatalog:
rpm -qa | grep hdfs, && rpm -qa | grep hive && rpm -qa | grep hcatalog
No component files names should appear in the returned list.

	Important
For Falcon, we recommend upgrading from HDP 2.1 to HDP 2.2 and then upgrading HDP 2.2 to HDP 2.4. See Configure and Validate Falcon for more information.

	Note
If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

Ubuntu 12

On all hosts, clean the apt-get repository.
apt-get clean -&-all

Remove your old HDP 2.1 components. This command uninstalls the HDP 2.1 components. It leaves the user data, and metadata, but removes your configurations:

apt-get remove "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "tez.*" "storm*" "falcon*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue.*" "knox*" "hdp_mon_nagios_addons" --purge

Validate that all HDP 2.1 component binaries are uninstalled:
yum list installed | grep @HDP2.1
Remove your old hdp.repo file:
rm /etc/apt/sources.list.d/hdp.list
Download the HDP-2.4.0 hdp.repo file:
wget http://public-repo-1.hortonworks.com/HDP/ubuntu12/2.x/updates/2.4.0.0/hdp.list - O /etc/apt/sources.list.d/hdp.list
Run an update:
apt-get update
Install the HDP-2.4.0 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components:
Important
For Falcon, we recommend upgrading from HDP 2.1 to HDP 2.2 and then upgrading HDP 2.2 to HDP 2.4. See Configure and Validate Falcon for more information.
```
apt-get install "hadoop" "hadoop-hdfs" "libhdfs0" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "hive-webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "tez" "storm" "flume" "phoenix" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"
```
Note
If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

	Important
For Falcon, we recommend upgrading from HDP 2.1 to HDP 2.2 and then upgrading HDP 2.2 to HDP 2.4. See Configure and Validate Falcon for more information.

	Note
If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

Debian 6 (Deprecated)

HDP support for Debian 6 is deprecated with HDP 2.4.0. Future versions of HDP will no longer be supported on Debian 6.

On all hosts, clean the apt-get repository.
apt-get clean -&-all

Remove your old HDP 2.1 components. This command uninstalls the HDP 2.1 components. It leaves the user data, and metadata, but removes your configurations:

apt-get remove "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "tez*" "storm*" "falcon*" "flume*" "phoenix*" "accumulo*" "mahout*" "hue*" "knox*" "hdp_mon_nagios_addons"

Validate that all HDP 2.1 component binaries are uninstalled:
yum list installed | grep @HDP2.1
Remove your old hdp.repo file:
rm /etc/apt/sources.list.d/hdp.list
Download the HDP-2.4.0 hdp.repo file:
wget -nv http://public-repo-1.hortonworks.com/HDP/debian6/2.x/updates/2.4.0.0/hdp.list - O /etc/apt/sources.list.d/hdp.list
Run an update:
apt-get update
Install the HDP-2.4.0 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.1 components:
Important
For Falcon, we recommend upgrading from HDP 2.1 to HDP 2.2 and then upgrading HDP 2.2 to HDP 2.4. See Configure and Validate Falcon for more information.
```
apt-get install "hadoop" "hadoop-hdfs" "libhdfs0" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "hive-webhcat" "hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "tez" "storm" "flume" "phoenix" "accumulo" "mahout" "knox" "hdp_mon_nagios_addons"
```
Note
If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

	Important
For Falcon, we recommend upgrading from HDP 2.1 to HDP 2.2 and then upgrading HDP 2.2 to HDP 2.4. See Configure and Validate Falcon for more information.

	Note
If you installed Apache Argus, it is now Apache Ranger. See Upgrade Ranger for more information on the upgrade path.

Install the Compression Libraries. See Install Compression Libraries.

​Upgrade HDP 2.1 Components

Upgrade HDP 2.1 Components