Upgrading a Cluster

Minimum Required Role: Cluster Administrator (also provided by Full Administrator) This feature is not available when using Cloudera Manager to manage Data Hub clusters.

This topic describes how to upgrade a CDH or Cloudera Runtime cluster in any of the following scenarios:
  • From any 5.x version to a higher version of CDH.
  • From CDH 5.13 or higher to Cloudera Runtime 7.1 or higher.
  • From Cloudera Runtime to a higher version of Cloudera Runtime.
  • Upgrade CDH or Cloudera Runtime to maintenance releases.
When you upgrade a cluster, you use Cloudera Manager to upgrade the cluster software across an entire cluster using either Cloudera Parcels or, by using RPM-based package commands. Package-based installations are not supported for Cloudera Runtime and CDP Private Cloud Base upgrades. You must transition you CDH cluster to use Parcels before upgrading to CDP Private Cloud Base.
  • Parcels – This option uses Cloudera Manager to upgrade CDH or Cloudera Runtime and allows you to upgrade your cluster either using a full restart of the cluster, or you can perform a rolling restart if you have HDFS high availability enabled and have a Cloudera Enterprise license. The use of Parcels requires that your cluster be managed by Cloudera Manager. This includes any components that are not a regular part of CDH, such as Spark 2.
  • Packages – This option is the most time consuming and requires you to log in using ssh and execute a series of package commands on all hosts in your cluster. Cloudera recommends that you instead upgrade your cluster using parcels, which allows Cloudera Manager to distribute the upgraded software to all hosts in the cluster without having to log in to each host. If the CDH cluster you are upgrading was installed using packages, you can upgrade it using parcels, and the upgraded version of CDH will then use parcels for future upgrades or changes. You can also transition your cluster from using packages to using parcels before starting the upgrade.

Cluster upgrades update the Hadoop software and other components. You can use Cloudera Manager to upgrade a cluster for major, minor, and maintenance upgrades. The procedures vary depending on the version of Cloudera Manager you are using and the version of CDH or Cloudera Runtime you are upgrading to.

After completing preparatory steps, you use the Cloudera Manager upgrade wizard to complete the upgrade. If you use parcels (recommended), have enabled HDFS high availability, and have a Cloudera Enterprise license, you can perform a rolling upgrade that does not require you to take the cluster offline during the upgrade.

For cluster upgrade steps, see Upgrading the Cluster.