Overview

Before upgrading to higher versions of CDH and transitioning to CDP Private Cloud Base, you must understand the types of upgrades so that you can make an informed decision about the target release version. Reviewing the new features and changes in the target release enables you to understand the upgrade requirements.

Before beginning your upgrade, review the list of supported upgrade paths to ensure that the upgrade you are planning is supported. Upgrades are not supported between all versions of Cloudera Manager, CDH, or Cloudera Runtime. See Supported Upgrade Paths.

Upgrading consists of two major steps, upgrading Cloudera Manager and upgrading the cluster. You are not required to upgrade Cloudera Manager and the cluster at the same time, but the versions of Cloudera Manager and the cluster must be compatible. The major+minor version of Cloudera Manager must be equal to or higher than the major+minor version of CDH or Cloudera Runtime.

About the online Upgrade Guide

This online version of the Cloudera Upgrade Guide allows you to create a customized version of the guide that only includes the steps required for your upgrade. Use the form at the top of pages in this guide to select the Cloudera Manager, CDH or Cloudera Runtime version for your upgrade as well as the operating system version, database type, and other information about your upgrade. After making these selections, the pages in the guide will only include the required steps for your upgrade. The information you enter is retained on each page in the guide.

Upgrading to CDP Private Cloud Base

An upgrade from Cloudera Manager and CDH to CDP Private Cloud Base consists of the following high-level steps:
  1. Review the Upgrade Guide topic on Supported Upgrade Paths.
  2. Gather information on your deployment. See Getting Started Upgrading Cloudera Manager and Getting Started Upgrading a Cluster.
  3. Plan how and when to begin your upgrade.
  4. Upgrade Cloudera Manager to version 7.1.1 or higher. After upgrading to Cloudera Manager 7.1.1 or higher, Cloudera Manager will manage upgrading your cluster to a higher version. See Upgrading Cloudera Manager.
  5. Perform any needed pre-upgrade transition steps for the components deployed in your clusters. See CDP Private Cloud Base Pre-upgrade steps
  6. Use Cloudera Manager to Upgrade CDH to Cloudera Runtime 7, or from Cloudera Runtime to a higher version of Cloudera Runtime. See Upgrading a cluster.
  7. Perform any needed post-upgrade transition steps for the components deployed in your clusters. See Post-CDP upgrade transitions.

Upgrades from Cloudera Manager and CDH 5 or 6 to higher versions of Cloudera Manager

Supported upgrades:
  • Any CDH 5 or 6 clusters to higher versions of CDH
  • Cloudera Manager 5 or 6 to higher versions of Cloudera Manager.
An upgrade from Cloudera Manager and CDH 5 or 6 to higher versions of Cloudera Manager consists of the following high-level steps:
  1. Review the Upgrade Guide topic on supported Upgrade Paths.

  2. Gather information on your deployment.

  3. Plan how and when to begin your upgrade.

  4. Upgrade Cloudera Manager. After upgrading Cloudera Manager, Cloudera Manager will manage upgrading your cluster to a higher version.

  5. Perform any needed pre-transition steps for the components deployed in your clusters.

  6. Use Cloudera Manager to Upgrade CDH.

  7. Perform any needed post-transition steps for the components deployed in your clusters.

Consult the topics in this guide to plan and execute your upgrades.

Assessing the Impact of an Upgrade

Plan for a sufficient maintenance window to perform an upgrade. Depending on which components you are upgrading, the number of hosts in your cluster, and the type of hardware, you might need up to a full day to upgrade your cluster. Before you begin the upgrade, you need to gather some information; these steps are also detailed in the Cloudera Manager and CDH upgrade procedures.

Before upgrading, consult the release notes for Cloudera Manager and CDH to learn about API changes, deprecated features, new features, and incompatible changes.

Also check the following pages to make sure that you are using a supported operating system, JDK, database, and other components:
There are three types of upgrades: major, minor, and maintenance:
Major Upgrades
Major upgrades include the following:
  • From Cloudera Manager 5.x and CDH 5.x to Cloudera Manager 6.x and CDH 6.x
  • From Cloudera Manager 5.x and CDH 5.x to Cloudera Manager and Cloudera Runtime 7.1.1 or higher
  • From Cloudera Manager and Cloudera Runtime 7.0.3 to Cloudera Manager and Cloudera Runtime 7.1.1 (CDP Private Cloud Base)
  • From Cloudera Manager 6.x to Cloudera Manager 7.1.1
A major upgrade typically has the following characteristics:
  • Large changes to functionality and update of Hadoop to a more recent version
  • Incompatible changes in data formats
  • Significant changes and additions to the user interface in Cloudera Manager
  • Database schema changes for Cloudera Manager that are automatically handled by the upgrade process
  • Significant down time is required to upgrade the cluster.
  • Client Configurations are redeployed.
Minor Upgrades
Minor upgrades upgrade your software to a higher minor version of a major release—for example from version 6.0.0 to version 6.1.0—and typically include the following:
  • New functionality
  • Bug fixes
  • Potential database schema changes for Cloudera Manager that are handled automatically
  • Client Configurations are redeployed.
Incompatible changes or changes to data formats are generally not introduced in minor upgrades.
Maintenance Upgrades

Maintenance upgrades fix critical bugs or address security issues. The version numbers for maintenance releases differ only in the third digit, for example, when upgrading from version 6.0.0 to 6.0.1.

To upgrade to a maintenance release, you only need to perform a subset of the Minor version upgrade steps. Follow the same procedures as for minor version upgrades but skip the steps that are labeled as follows: