Upgrading HDP Manually
Also available as:
PDF
loading table of contents...

Chapter 1. Upgrade from HDP 2.3 to HDP 2.4.0 Manually

[Important]Important

Because HDP 2.3.6 contains features and fixes that are not applicable to HDP 2.4.0 or HDP 2.4.2, do not upgrade from HDP 2.3.6 to HDP 2.4.0 or HDP 2.4.2.

[Important]Important

If you installed and manage HDP 2.3 with Ambari, you must use the Ambari Upgrade Guide to perform the HDP 2.3 to HDP 2.4.0 upgrade.

[Note]Note

These instructions cover the upgrade between two minor releases. If you need to upgrade between two maintenance releases, follow the upgrade instructions in the HDP Release Notes.

Starting with HDP 2.2, HDP 2.4.0 supports side-by-side installation of HDP 2.2 and subsequent releases, which lets you perform rolling upgrades on your cluster and improve execution times for in-place upgrade. To support side-by-side installation, the HDP package version naming convention for both RPMs and Debs has changed to include the HDP product version. For example, hadoop-hdfs is now hadoop-2.4.0-hdfs. HDP 2.2 marked the first release where HDP rpms, debs, and directories contained versions in the names to permit side-by-side installations of later HDP releases. To select from the releases you have installed side-by-side, Hortonworks provided hdp-select, a command that lets you select the active version of HDP from the versions you have installed.

Now with HDP 2.4.0, you can take advantage of this versioned installation to perform Rolling Upgrade from 2.3 to 2.4.0. However, Rolling Upgrade involves complex orchestration as well as side-by-side installation. It is too complex for a manual procedure, and is therefore supported only as an Ambari feature. If you wish to perform a Rolling Upgrade, refer to the Ambari Install instructions to install Ambari, then follow the Ambari Rolling Upgrade instructions, see Ambari Upgrade Guide.

This chapter provides instructions on how to manually upgrade to HDP 2.4.0 from the HDP 2.3 release. It assumes the existing HDP 2.3 was also installed manually.

The HDP packages for a complete installation of HDP 2.4.0 will occupy about 2.5 GB of disk space.

[Warning]Warning

Until the upgrade is finalized, no HDFS data is deleted from the cluster. Be sure to review your capacity and ensure that you have extra space available during the upgrade window.

The following provides an overview of steps for upgrading to the latest release of HDP 2.4.0 from HDP 2.3:

[Important]Important

Because HDP 2.3.6 contains features and fixes that are not applicable to HDP 2.4.0 or HDP 2.4.2, do not upgrade from HDP 2.3.6 to HDP 2.4.0 or HDP 2.4.2.

  1. Get ready to upgrade

  2. Upgrade HDP 2.3 Components

  3. Use hdp-select to symlink the HDP 2.4.0 components into "current," in place of the former HDP 2.3 components

  4. Configure and Start Apache ZooKeeper

  5. Configure and Start Hadoop

  6. Start HDFS

  7. Configure and Start YARN/MapReduce

  8. Configure and Start Apache HBase

  9. Configure and Start Apache Phoenix

  10. Configure and Start Apache Accumulo

  11. Configure and Start Apache Tez

  12. Configure and Start Apache Hive and Apache HCatalog

  13. Configure and Start Apache Oozie

  14. Configure and Start Apache WebHCat (Templeton)

  15. Configure and Start Apache Pig

  16. Configure and Start Apache Sqoop

  17. Configure and Start Apache Flume

  18. Configure and Start Apache Mahout

  19. Configure and Start Hue

  20. Configure and Start Apache Knox

  21. Configure and Start Apache Falcon

  22. Configure and Start Apache Storm

  23. Configure and Start Apache Ranger

  24. Configure and Start Apache Spark

  25. Upgrade Apache Slider

  26. Upgrade Apache Kafka

  27. Upgrade Apache Atlas

  28. Finalize Upgrade