Cloudera Docs

Data Lake rolling upgrades

The Data Lake rolling upgrade allows you to upgrade the Data Lake Cloudera Runtime and OS without stopping attached Cloudera Data Hub clusters or Data Services. This allows workloads to continue running during the Data Lake upgrade operation.

Similarly to the classic Data Lake upgrade logic, a Data Lake rolling upgrade first upgrades the Cloudera Runtime version and then the OS.

To run a Data Lake rolling upgrade, the following requirements must be met:

  • The Data Lake must be Cloudera Runtime version 7.2.17.300+ to perform a rolling upgrade directly to 7.2.18+ and 7.3.1+.
  • The Data Lake OS must be RHEL 8. Rolling upgrades are not generally available from Data Lakes on CentOS.
  • The Data Lake must be an Enterprise Data Lake. Rolling upgrades to 7.2.18 or later versions are not generally available from Medium Duty or Light Duty Data Lakes.
If your Data Lake does not meet these requirements, you will first have to do a traditional Cloudera Runtime upgrade, upgrade your OS from CentOS to RHEL, or resize your Data Lake to Enterprise Data Lake before a rolling upgrade can be performed.
Current Runtime version Current OS Current Data Lake Shape Rolling upgrade support?
7.2.17.300+ RHEL 8 Enterprise Data Lake Yes, directly to 7.2.18+
7.2.17.300+

7.2.18.0+

 RHEL 8 Enterprise Data Lake Yes, directly to 7.3.1+1
7.3.1.0 RHEL 8 Enterprise Data Lake Yes, directly to the latest 7.3.1 Service Pack (SP) or Cumulative Hotfix (CHF) version

In some circumstances, a rolling upgrade may not be supported for a Data Lake cluster, but can be enabled through entitlement. Some cluster services might become unavailable during this type of upgrade, and running workloads could be impacted. The Data Lake upgrade UI displays information about whether a rolling upgrade is available, unavailable, or may be available under entitlement. For instructions on performing a Data Lake upgrade, including rolling upgrades, see Upgrading a Data Lake. For information about obtaining an entitlement for rolling upgrade, contact Cloudera Customer Support.

1

When upgrading to Cloudera Runtime 7.3.1 using the Cloudera Management Console, you are upgraded to the latest available Service Pack (SP) or Cumulative Hotfix (CHF) after selecting 7.3.1 as the target Cloudera Runtime version.

You can specify the exact Cloudera Runtime version, such as 7.3.1.0 or 7.3.1.10x, using CDP CLI with image ID. In this case, ensure that there is a supported upgrade path for your source Cloudera Runtime version. For more information, see the Supported Cloudera Runtime 7.3.1 upgrade paths.