Chapter 3. Upgrade from HDP 2.1 to HDP 2.4.0 Manually
Important | |
---|---|
If you installed and manage HDP-2.1 with Ambari, you must use the Ambari Upgrade Guide to perform the the HDP-2.1 to HDP-2.4.0 upgrade. |
Note | |
---|---|
These instructions cover the upgrade between two minor releases, such as HDP-2.1 to HDP-2.4. Component information has been updated for HDP-2.4.0 where appropriate. If you need to upgrade between two maintenance releases such as HDP-2.1.x to 2.1.7, follow the upgrade instructions in the HDP Release Notes. |
Starting with HDP-2.2, HDP supports side-by-side installation of HDP 2.2 and subsequent releases, which lets you perform rolling upgrades on your cluster and improve execution times for in-place upgrade. To support side-by-side installation, the HDP package version naming convention for both RPMs and Debs has changed to include the HDP product version. For example, hadoop-hdfs in HDP-2.2.4 is now hadoop_2.2.4.0.hdfs. HDP-2.2 marked the first release where HDP rpms, debs, and directories contained versions in the names to permit side-by-side installations of later HDP releases. To select from the releases you have installed side-by-side, Hortonworks provides hdp-select, a command that lets you select the active version of HDP from the versions you have installed.
However, because HDP-2.1 did not support side-by-side installation, you will upgrade to HDP-2.4.0 in a way very similar to previous minor-version upgrades. Subsequent upgrades after 2.4.0 will be easier, and if you choose to add Ambari to your cluster, you will be able to use the Rolling Upgrade feature.
Important | |
---|---|
You cannot perform a side-by-side rolling upgrade from HDP 2.1 to HDP-2.4.0; only upgrade in place is supported. Side-by-side and rolling upgrade support starts with releases HDP 2.2 and above. |
This document provides instructions on how to manually upgrade to HDP-2.4.0 from the HDP 2.1 release. It assumes the existing HDP 2.1 was also installed manually.
The HDP packages for a complete installation of HDP-2.4.0 will take about 2.5 GB of disk space.
Warning | |
---|---|
Until the upgrade is finalized, no HDFS data is deleted from the cluster. Be sure to review your capacity and ensure that you have extra space available during the upgrade window. |
Important | |
---|---|
You are strongly encouraged to read completely through this entire document before starting the Manual Upgrade process, in order to understand the interdependencies and the order of the steps. |
The following steps are required to upgrade from HDP-2.1 to the latest release of HDP-2.4.0 from HDP-2.1:
Get ready to upgrade
Upgrade HDP 2.1 Components
Symlink Directories with hdp-select
Configure and Start Apache ZooKeeper
Configure and Start Hadoop
Start HDFS
Configure and Start Apache HBase
Configure and Start Apache Phoenix
Configure and Start Apache Accumulo
Configure and Start Apache Tez
Configure and Start Apache Hive and Apache HCatalog
Configure and Start Apache Oozie
Configure and Start Apache WebHCat (Templeton)
Configure and Start Apache Pig
Configure and Start Apache Sqoop
Configure and Start Apache Flume
Configure and Validate Apache Mahout
Configure and Start Hue
Configure and Start Apache Knox
Configure and Start Apache Falcon
Finalize Upgrade
Install new HDP services if desired