Upgrade and migration paths

Cloudera encourages you to run NiFi on Cloudera Data Platform (CDP) so that you can take advantage of the latest updates and features. You can run NiFi on CDP by installing the CFM parcel on top of CDP. You can upgrade or migrate from earlier versions of CFM on CDP Private Cloud Base or from HDF and CFM on CDH. Review the upgrade and migration information to ensure that you are aware of the requirements pertaining to the upgrade or migration scenario appropriate to your use case.

Upgrade and migration paths overview

You are using CFM 2.x on CDP Private Cloud Base

If you are using CFM 2.x on CDP Private Cloud Base 7.1.1-7.1.9, and you want to upgrade to a higher version of CFM, there are specific upgrade paths that you need to take. Review them in the Upgrade and migration paths diagram and see the procedure steps in the following table:

Table 1. Upgrade procedure from CFM 2.x
Upgrade
Step 1. Upgrade CFM to 2.0.4 if you are using CFM 2.0.1
Step 2. Upgrade CDP Private Cloud Base to 7.1.7, 7.1.7 SP1, or 7.1.7 SP2
Step 3.

Check the Upgrade and migration paths diagram to identify the sequence of intermediate upgrades required to transition from your current CFM version to the desired one.

Upgrade to CFM 2.1.5 from lower CFM 2.x versions

Upgrade to CFM 2.1.6 from CFM 2.1.5

Upgrade to CFM 2.1.7 from CFM 2.1.6

Step 4. Upgrade CDP Private Cloud Base to 7.1.8 or 7.1.9

You are using CFM 1.x on CDH

If you are using CFM 1.x on CDH 5 or CDH 6, or as standalone CFM, and you want to upgrade to a higher version of CFM, there are specific upgrade paths that you can take. Compare the different upgrade options in the Upgrade and migration paths diagram and see both migration and upgrade processes in the following table:

Table 2. Upgrade procedure options from CFM 1.x
Migration Upgrade from CFM 1.x on CDH 6 Upgrade from CFM 1.x on CDH 5 Upgrade from standalone CFM 1.x
Step 1. Upgrade from CFM 1.0.0 to CFM 1.1.0 Upgrade from CFM 1.0.1 to CFM 1.1.0 Upgrade from CFM 1.0.0 to CFM 1.1.0 Upgrade from CFM 1.0.1 to CFM 1.1.0 Upgrade from CFM 1.0.0 to CFM 1.1.0 Upgrade from CFM 1.0.1 to CFM 1.1.0 Upgrade from CFM 1.0.0 to CFM 1.1.0 Upgrade from CFM 1.0.1 to CFM 1.1.0
Step 2. Install CFM 2.x on CDP Private Cloud Base 7.1.1 - 7.1.8 Upgrade from CDH 6 to CDP Private Cloud Base 7.1.7, 7.1.7 SP1 or 7.1.7 SP2 Upgrade from CDH/CM 5.0-5.12 to CDH/CM 5.13 or higher.

See also the Cloudera Enterprise Upgrade Guide.

Upgrade from CFM 1.1.0 to CFM 2.x
Step 3. Migrate data from CFM 1.x to CFM 2.x Upgrade from CFM 1.1.0 to CFM 2.x Upgrade from CDH 5.13 or higher to CDP Private Cloud Base 7.1.1 or 7.1.7
Step 4. Upgrade from CFM 1.1.0 to CFM 2.x

For an explanation on the differences between upgrade and migration, see CFM upgrade and migration options.

You are using HDF

If you are using HDF and you want to upgrade to CFM, there are specific upgrade paths that you can take. Compare the different upgrade options in the Upgrade and migration paths diagram and see both migration and in-place upgrade processes in the following table:

Table 3. Upgrade procedure options from HDF
Migration In-place upgrade
Step 1. Upgrade HDF to 3.5.x.

See also the HDF 3.5.2 Release Notes.

Upgrade HDF to 3.5.2.

See also the HDF 3.5.2 Release Notes.

Step 2. Install CFM 2.x on CDP Private Cloud Base 7.1.1 - 7.1.8
Step 3. Migrate data from HDF to CFM

For an explanation on the differences between in-place upgrade and migration, see CFM upgrade and migration options.

CFM upgrade and migration options

There are three methods to change from an older version to CFM 2.x.

Upgrade
Upgrade refers to a full upgrade of CFM on CDP Private Cloud Base without the need of having to migrate data between clusters.
Possible paths:
  • CFM 1.1.0 > CFM 2.x
  • CFM 2.x > higher CFM 2.x versions
Migration
Data migration refers to moving existing HDF or CFM 1.x cluster workloads to a new installation of CDP Private Cloud Base. You can move your NiFi dataflows and NiFi Registry versioned flows from an HDF 3.5.x or CFM 1.1.0 (standalone, or on CDH 5 or CDH 6) cluster to a CFM 2.x cluster on CDP Private Cloud Base. It requires that you have both your HDF or CFM 1.1.0 clusters and a CFM 2.x cluster running at the same time. Cloudera recommends migration over in-place upgrade.
Possible paths:
  • HDF 3.5.x > CFM 2.x
  • CFM 1.1.0 > CFM 2.x

For detailed information on performing migration, see Migration from HDF 3.5.x or CFM 1.1.0 to CFM 2.x on CDP.

In-place upgrade
This option enables you to install Cloudera Manager when using HDF and allows Cloudera Manager to take over the management of your services. You can convert your existing Ambari blueprint to a Cloudera Manager Deployment template using the AM2CM tool. Cloudera recommends migration over in-place upgrade. If you have a version of HDF lower than 3.5.2.0, first upgrade to HDF 3.5.2.0 and then upgrade HDF to CFM 2.1.1-2.1.4 on CDP Private Cloud Base 7.1.6 or 7.1.7.
Possible paths:
  • HDF 3.5.2.0 > CFM 2.1.1 on CDP 7.1.6
  • HDF 3.5.2.0 > CFM 2.1.1-2.1.5 on CDP 7.1.7
For detailed information on performing an in-place upgrade, see: