Cloudera Upgrade Guide Companion

Welcome to the Cloudera Upgrade Guide Companion.

This upgrade guide companion will help you in achieving the key milestones for successfully completing an in-place upgrade of your cluster.

Use the My Environment section to define your cluster upgrade configuration. Use the tabs below to access key checkpoints for completing your upgrade and as a jumping off point for each individual milestone.

You can always review the complete upgrade documentation here.

You must review the supported upgrade paths information before upgrading to CDP cluster here.

You must review the supported Cloudera Manager information before upgrading to CDP cluster here.

Loading Filters ...
Loading Filters ... 7.7.3 7.7.1 7.6.7 7.6.1 7.4.4 7.3.1 7.2.4 7.1.4 7.1.3 7.1.2 7.1.1 7.0.3 6.3.4 6.3.3 6.3.1 6.3.0 6.2.1 6.2.0 6.1.1 6.1.0 6.0.1 6.0.0 5.16 5.15 5.14 5.13 7.11.3 6.3.4 6.3.3 6.3.2 6.3.0 6.2.1 6.2.0 6.1.1 6.1.0 6.0.1 6.0.0 5.16 5.15 5.14 5.13 7.1.9 7.1.7.2000 7.1.8 7.1.7.1000 7.1.7 7.1.6 7.1.5 7.1.4 7.1.3 7.1.2 7.1.1 7.0.3
Loading Filters ...
Loading Filters ... 7.7.3 7.7.1 7.6.7 7.6.1 7.1.7.2000 7.1.8 7.1.7.1000 7.1.7 7.1.6 7.1.5 7.1.4 7.1.3 7.1.2 7.1.1 7.0.3 7.1.9
Loading Filters ... 7.7.3 7.7.1 7.6.7 7.6.1 7.1.7.1000 7.1.7.2000

Getting Started

Upgrading HDP to CDP

To get started with upgrading from HDP to CDP, first learn about the overall upgrade process and the impact of an upgrade on your deployment.

HDP 2 to CDP

See Preparing your upgrade

See CDP Upgrade Readiness

HDP 3 to CDP

See Preparing your upgrade

See CDP Upgrade Readiness

Upgrading CDH to CDP

To get started with upgrading from CDH to CDP, first learn about the overall upgrade process and the impact of an upgrade on your deployment.

CDH 5 to CDP

When upgrading from CDH 5.x, you should review:

CDH 6 to CDP

When upgrading from CDH 6.x, you should review

Upgrading CDP to a higher version

Upgrading to CDP Private Cloud Base 7.1.9
You can upgrade to CDP 7.1.9 from the following CDP versions: You must also make sure you upgrade to the supported version of Cloudera Manager before you perform the upgrade process. For more information, See Upgrading Cloudera Manager. To get started with upgrading to a newer version of CDP, first learn about the overall upgrade process and the impact of an upgrade on your deployment. See Preparing for your upgrade
CDP 7.1.x to a higher version of CDP

To get started with upgrading to a newer version of CDP, first learn about the overall upgrade process and the impact of an upgrade on your deployment. See Preparing for your upgrade

Upgrading CDP to a Serivce Pack

Upgrades to CDP Private Cloud Base 7.1.7 Service Pack 2 (SP2)

Note the following requirements for upgrades to CDP Private Cloud Base 7.1.7 SP2:

  • You can upgrade to Cloudera Runtime 7.1.7 Service Pack 2 (7.1.7.2000) from Cloudera Runtime 7.1.7 Service Pack 1 (7.1.7.1000) or Cloudera Runtime 7.1.7 (log4j2) or Cloudera Runtime 7.1.6.
  • You must first upgrade to Cloudera Manager 7.6.7, which is the supported version for Service Pack 2.
  • You cannot use Cloudera Manager 7.6.7 to manage deployments where Cloudera Manager is managing a CDP Private Cloud Data Services cluster.

Pre-upgrade Tasks

Gather information on your deployment and verify cluster environment readiness. You can prepare a sample data for ingestion and validate the Apache Hive constructs before you upgrade.

HDP 2 to CDP

Cluster Environment Readiness here

Sample Data Ingestion here

Hive Validations here

Ambari and HDP Checklists here

HDP 3 to CDP

Cluster Environment Readiness here

Sample Data Ingestion here

Merge Independent Hive and Spark Catalogs here

Ambari and HDP Checklists here

CDH 5 to CDP
The following procedures must be completed before performing a cluster upgrade to CDP Private Cloud Base (Cloudera Runtime 7.1.1 or higher). Only complete the procedures for services running in your source cluster:In addition to the pre-upgrade steps for Cloudera Runtime services, you may also need to do upgrade your JDK or operating system. See the Cloudera support Matrix for more information on supported operating systems and JDKs.
After you complete these steps, continue with your upgrade by Upgrading Cloudera Manager.
CDH 6 to CDP
The following procedures must be completed before performing a cluster upgrade to CDP Private Cloud Base (Cloudera Runtime 7.1.1 or higher). Only complete the procedures for services running in your source cluster:
In addition to the pre-upgrade steps for Cloudera Runtime services, you may also need to do upgrade your JDK or operating system. See the Cloudera support Matrix for more information on supported operating systems and JDKs.
After you complete these steps, continue with your upgrade by Upgrading Cloudera Manager.
CDP to a higher version of CDP
You may need to upgrade your JDK or operating system. See the Cloudera support Matrix for more information on supported operating systems and JDKs.
After you complete these steps, continue with your upgrade by Upgrading Cloudera Manager.

Placeholder

Upgrade the Cluster

Plan how and when to begin your upgrade. Check readiness and upgrade Ambari and HDP. Transition from HDP to Cloudera Manager.

HDP 2 to CDP

Upgrade Ambari here

Upgrade HDP here

Pre-Transition steps here

Cloudera Manager Installation here

Installing JDBC driver here

Transitioning HDP 2.6.5 cluster to CDP Private Cloud Base cluster using the AM2CM tool here

HDP 3 to CDP

Upgrade Ambari here

Upgrade HDP here

Pre-Transition steps here

Cloudera Manager Installation here

Installing JDBC driver here

Transitioning HDP 3.1.5 cluster to CDP Private Cloud Base cluster using the AM2CM tool here

CDH 5 to CDP

Upgrading a cluster requires some preparatory steps such as backing up your cluster and Cloudera Manager, establishing access to the software, and other tasks.

Before upgrading your cluster(s) you must first upgrade Cloudera Manager to a version that supports your planned cluster upgrades. See Upgrade Cloudera Manager.

For detailed procedures, see Upgrading a Cluster.

CDH 6 to CDP

Upgrading a cluster requires some preparatory steps such as backing up your cluster and Cloudera Manager, establishing access to the software, and other tasks.

Before upgrading your cluster(s) you must first upgrade Cloudera Manager to a version that supports your planned cluster upgrades. See Upgrade Cloudera Manager.

For detailed procedures, see Upgrading a Cluster.

CDP to a higher version of CDP
Upgrading a cluster requires some preparatory steps such as backing up your cluster and Cloudera Manager, establishing access to the software, and other tasks.

Before upgrading your cluster(s) you must first upgrade Cloudera Manager to a version that supports your planned cluster upgrades. See Upgrade Cloudera Manager.

For detailed procedures, see Upgrading a Cluster.

Placeholder

Post-Upgrade Tasks

If you have LDAP configured on your cluster, configure external authentication with Cloudera Manager. You can also install additional services like DAS and Hue. Test your applications and services on your cluster.

HDP 2 to CDP

Post Transition Steps here

Configuring External for Cloudera Manager here

Installing DAS on CDP Private Cloud Base here

Adding Hue service with Cloudera Manager here

HDP 3 to CDP

Post Transition Steps here

Configuring External for Cloudera Manager here

Installing DAS on CDP Private Cloud Base here

Adding Hue service with Cloudera Manager here

CDH 5 to CDP

The following procedures must be completed after performing a cluster upgrade to CDP Private Cloud Base (Cloudera Runtime 7.1.1 or higher). Only complete the procedures for services running in your source cluster:

CDH 6 to CDP

The following procedures must be completed after performing a cluster upgrade to CDP Private Cloud Base (Cloudera Runtime 7.1.1 or higher). Only complete the procedures for services running in your source cluster:

CDP to a higher version of CDP

Placeholder

Troubleshooting

You can review a list of possible causes and solutions to debug and resolve issues that you might face.

HDP to CDP

Post-upgrade HDP 2 Troubleshooting DAS Installation

Post-upgrade HDP 3 Troubleshooting DAS Installation

CDH 5 to CDP

If you need to review common things to check that you may have missed during your upgrade, review troubleshooting suggestions here.

CDH 6 to CDP

If you need to review common things to check that you may have missed during your upgrade, review troubleshooting suggestions here.

CDP to CDP
See Troubleshooting.

Placeholder