Cloudera Upgrade Guide Companion

Welcome to the Cloudera Upgrade Guide Companion.

This upgrade guide companion will help you in achieving the key milestones for successfully completing an in-place upgrade of your cluster.

Use the My Environment section to define your cluster upgrade configuration. Use the tabs below to access key checkpoints for completing your upgrade and as a jumping off point for each individual milestone.

You can always review the complete upgrade documentation here.

Loading Filters ...

Loading Filters ... 7.7.3 7.7.1 7.6.7 7.6.1 7.5.1 7.4.4 7.3.1 7.2.4 7.1.4 7.1.3 7.1.2 7.1.1 7.0.3 6.3.4 6.3.3 6.3.1 6.3.0 6.2.1 6.2.0 6.1.1 6.1.0 6.0.1 6.0.0 5.16 5.15 5.14 5.13 6.3.4 6.3.3 6.3.2 6.3.0 6.2.1 6.2.0 6.1.1 6.1.0 6.0.1 6.0.0 5.16 5.15 5.14 5.13 7.1.8 7.1.7.1000 7.1.7 7.1.6 7.1.5 7.1.4 7.1.3 7.1.2 7.1.1 7.0.3 7.1.7.2000 7.7.3 7.7.1 7.6.7 7.6.1 7.5.1 7.4.4 7.3.1 7.2.4 7.1.4 7.1.3 7.1.2 7.1.1 7.0.3

Loading Filters ...

Getting Started
Pre-upgrade Tasks
Upgrade the Cluster
Post-upgrade tasks
Troubleshooting

Getting Started

Upgrading HDP to CDP

To get started with upgrading from HDP to CDP, first learn about the overall upgrade process and the impact of an upgrade on your deployment.

HDP 2 to CDP: See Preparing your upgrade; See CDP Upgrade Readiness
HDP 3 to CDP: See Preparing your upgrade; See CDP Upgrade Readiness

Upgrading CDH to CDP

To get started with upgrading from CDH to CDP, first learn about the overall upgrade process and the impact of an upgrade on your deployment.

CDH 5 to CDP

See

Preparing for your upgrade Assessing the Impact of an Upgrade About using this online Upgrade Guide

CDH 6 to CDP

See

Upgrading CDP to a higher version

CDP 7.0.3 to a higher version of CDP

To get started with upgrading to a newer version of CDP, first learn about the overall upgrade process and the impact of an upgrade on your deployment. See Preparing for your upgrade

Upgrades to CDP Private Cloud Base 7.1.7 Service Pack 2 (SP2)

Note the following requirements for upgrades to CDP Private Cloud Base 7.1.7 SP2:

You can upgrade to Cloudera Runtime 7.1.7 Service Pack 2 (7.1.7.2000) from Cloudera Runtime 7.1.7 Service Pack 1 (7.1.7.1000) or Cloudera Runtime 7.1.7 (log4j2) or Cloudera Runtime 7.1.6. An upgrade to Cloudera Manager 7.6.7 is also required for SP2.
You must first upgrade to Cloudera Manager 7.6.7, which is the supported version for Service Pack 2.
You cannot use Cloudera Manager 7.6.7 to manage deployments where Cloudera Manager is managing a CDP Private Cloud Data Services cluster.

Pre-upgrade Tasks

Gather information on your deployment and verify cluster environment readiness. You can prepare a sample data for ingestion and validate the Apache Hive constructs before you upgrade.

HDP 2 to CDP

Cluster Environment Readiness here

Sample Data Ingestion here

Hive Validations here

Ambari and HDP Checklists here

HDP 3 to CDP

Cluster Environment Readiness here

Sample Data Ingestion here

Merge Independent Hive and Spark Catalogs here

Ambari and HDP Checklists here

CDH 5 to CDP

The following procedures must be completed before performing a cluster upgrade to CDP Private Cloud Base (Cloudera Runtime 7.1.1 or higher). Only complete the procedures for services running in your source cluster:

In addition to the pre-upgrade steps for Cloudera Runtime services, you may also need to do upgrade your JDK or operating system. See the Cloudera support Matrix for more information on supported operating systems and JDKs.

After you complete these steps, continue with your upgrade by Upgrading Cloudera Manager.

CDH 6 to CDP

After you complete these steps, continue with your upgrade by Upgrading Cloudera Manager.

CDP to a higher version of CDP

You may need to upgrade your JDK or operating system. See the Cloudera support Matrix for more information on supported operating systems and JDKs.

After you complete these steps, continue with your upgrade by Upgrading Cloudera Manager.

Upgrade the Cluster

Plan how and when to begin your upgrade. Check readiness and upgrade Ambari and HDP. Transition from HDP to Cloudera Manager.

HDP 2 to CDP

Upgrade Ambari here

Upgrade HDP here

Pre-Transition steps here

Cloudera Manager Installation here

Installing JDBC driver here

Transitioning HDP 2.6.5 cluster to CDP Private Cloud Base cluster using the AM2CM tool here

HDP 3 to CDP

Upgrade Ambari here

Upgrade HDP here

Pre-Transition steps here

Cloudera Manager Installation here

Installing JDBC driver here

Transitioning HDP 3.1.5 cluster to CDP Private Cloud Base cluster using the AM2CM tool here

CDH 5 to CDP

Upgrading a cluster requires some preparatory steps such as backing up your cluster and Cloudera Manager, establishing access to the software, and other tasks.

Before upgrading your cluster(s) you must first upgrade Cloudera Manager to a version that supports your planned cluster upgrades. See Upgrade Cloudera Manager.

For detailed procedures, see Upgrading a Cluster.

CDH 6 to CDP

Upgrading a cluster requires some preparatory steps such as backing up your cluster and Cloudera Manager, establishing access to the software, and other tasks.

Before upgrading your cluster(s) you must first upgrade Cloudera Manager to a version that supports your planned cluster upgrades. See Upgrade Cloudera Manager.

For detailed procedures, see Upgrading a Cluster.

CDP to a higher version of CDP

Upgrading a cluster requires some preparatory steps such as backing up your cluster and Cloudera Manager, establishing access to the software, and other tasks.

Before upgrading your cluster(s) you must first upgrade Cloudera Manager to a version that supports your planned cluster upgrades. See Upgrade Cloudera Manager.

For detailed procedures, see Upgrading a Cluster.

Upgrades to CDP Private Cloud Base 7.1.7 Service Pack 2 (SP2)

Note the following requirements for upgrades to CDP Private Cloud Base 7.1.7 SP2:

Upgrades CDP Private Cloud Base 7.1.7 Service Pack 2 are only supported from CDP Private Cloud Base 7.1.7.
You must first upgrade to Cloudera Manager 7.6.7, which is the supported version for Service Pack 2.
You cannot use Cloudera Manager 7.6.7 to manage deployments where Cloudera Manager is managing a CDP Private Cloud Data Services cluster.

Post-Upgrade Tasks

If you have LDAP configured on your cluster, configure external authentication with Cloudera Manager. You can also install additional services like DAS and Hue. Test your applications and services on your cluster.

HDP 2 to CDP

Post Transition Steps here

Configuring External for Cloudera Manager here

Installing DAS on CDP Private Cloud Base here

Adding Hue service with Cloudera Manager here

HDP 3 to CDP

Post Transition Steps here

Configuring External for Cloudera Manager here

Installing DAS on CDP Private Cloud Base here

Adding Hue service with Cloudera Manager here

CDH 5 to CDP

The following procedures must be completed after performing a cluster upgrade to CDP Private Cloud Base (Cloudera Runtime 7.1.1 or higher). Only complete the procedures for services running in your source cluster:

CDH 6 to CDP

CDP to a higher version of CDP

Complete Post-Upgrade steps for upgrades to CDP Private Cloud Base

Troubleshooting

You can review a list of possible causes and solutions to debug and resolve issues that you might face.

HDP to CDP

Post-upgrade HDP 2 Troubleshooting DAS Installation

Post-upgrade HDP 3 Troubleshooting DAS Installation

CDH 5 to CDP: See Troubleshooting.
CDH 6 to CDP: See Troubleshooting.

CDP to CDP: See Troubleshooting.