Chapter 1. Upgrade from HDP 2.3 to HDP 2.4.0 Manually
Important | |
---|---|
Because HDP 2.3.6 contains features and fixes that are not applicable to HDP 2.4.0 or HDP 2.4.2, do not upgrade from HDP 2.3.6 to HDP 2.4.0 or HDP 2.4.2. |
Important | |
---|---|
If you installed and manage HDP 2.3 with Ambari, you must use the Ambari Upgrade Guide to perform the HDP 2.3 to HDP 2.4.0 upgrade. |
Note | |
---|---|
These instructions cover the upgrade between two minor releases. If you need to upgrade between two maintenance releases, follow the upgrade instructions in the HDP Release Notes. |
Starting with HDP 2.2, HDP 2.4.0 supports side-by-side installation of HDP 2.2 and subsequent releases, which lets you perform rolling upgrades on your cluster and improve execution times for in-place upgrade. To support side-by-side installation, the HDP package version naming convention for both RPMs and Debs has changed to include the HDP product version. For example, hadoop-hdfs is now hadoop-2.4.0-hdfs. HDP 2.2 marked the first release where HDP rpms, debs, and directories contained versions in the names to permit side-by-side installations of later HDP releases. To select from the releases you have installed side-by-side, Hortonworks provided hdp-select, a command that lets you select the active version of HDP from the versions you have installed.
Now with HDP 2.4.0, you can take advantage of this versioned installation to perform Rolling Upgrade from 2.3 to 2.4.0. However, Rolling Upgrade involves complex orchestration as well as side-by-side installation. It is too complex for a manual procedure, and is therefore supported only as an Ambari feature. If you wish to perform a Rolling Upgrade, refer to the Ambari Install instructions to install Ambari, then follow the Ambari Rolling Upgrade instructions, see Ambari Upgrade Guide.
This chapter provides instructions on how to manually upgrade to HDP 2.4.0 from the HDP 2.3 release. It assumes the existing HDP 2.3 was also installed manually.
The HDP packages for a complete installation of HDP 2.4.0 will occupy about 2.5 GB of disk space.
Warning | |
---|---|
Until the upgrade is finalized, no HDFS data is deleted from the cluster. Be sure to review your capacity and ensure that you have extra space available during the upgrade window. |
The following provides an overview of steps for upgrading to the latest release of HDP 2.4.0 from HDP 2.3:
Important | |
---|---|
Because HDP 2.3.6 contains features and fixes that are not applicable to HDP 2.4.0 or HDP 2.4.2, do not upgrade from HDP 2.3.6 to HDP 2.4.0 or HDP 2.4.2. |
Get ready to upgrade
Upgrade HDP 2.3 Components
Use hdp-select to symlink the HDP 2.4.0 components into "current," in place of the former HDP 2.3 components
Configure and Start Apache ZooKeeper
Configure and Start Hadoop
Start HDFS
Configure and Start YARN/MapReduce
Configure and Start Apache HBase
Configure and Start Apache Phoenix
Configure and Start Apache Accumulo
Configure and Start Apache Tez
Configure and Start Apache Hive and Apache HCatalog
Configure and Start Apache Oozie
Configure and Start Apache WebHCat (Templeton)
Configure and Start Apache Pig
Configure and Start Apache Sqoop
Configure and Start Apache Flume
Configure and Start Apache Mahout
Configure and Start Hue
Configure and Start Apache Knox
Configure and Start Apache Falcon
Configure and Start Apache Storm
Configure and Start Apache Ranger
Configure and Start Apache Spark
Upgrade Apache Slider
Upgrade Apache Kafka
Upgrade Apache Atlas
Finalize Upgrade