Upgrade and migration paths

Cloudera encourages you to run NiFi on Cloudera Data Platform (CDP) so that you can take advantage of the latest updates and features. You can run NiFi on CDP by installing the CFM parcel on top of CDP. You can upgrade or migrate from earlier versions of CFM on CDP Private Cloud Base or from HDF and CFM on CDH. Review the upgrade and migration information to ensure that you are aware of the requirements pertaining to the upgrade or migration scenario appropriate to your use case.

Upgrade and migration paths overview

You are using CFM 2.x on CDP Private Cloud Base

If you are using CFM 2.x on CDP Private Cloud Base 7.1.1-7.1.9, and you want to upgrade to a higher version of CFM, there are specific upgrade paths that you need to take. Review them in the Upgrade and migration paths diagram and see the procedure steps in the following table:

Table 1. Upgrade procedure from CFM 2.x
Upgrade
Step 1. Upgrade CFM to 2.0.4 if you are using CFM 2.0.1
Step 2. Upgrade CDP Private Cloud Base to 7.1.7, 7.1.7 SP1, or 7.1.7 SP2
Step 3.

Check the Upgrade and migration paths diagram to identify the sequence of intermediate upgrades required to transition from your current CFM version to the desired one.

Upgrade to CFM 2.1.5 from CFM 2.x

Upgrade to CFM 2.1.6 from CFM 2.1.5

Upgrade to CFM 2.1.7 from CFM 2.1.6

Step 4. Upgrade CDP Private Cloud Base to 7.1.8 or 7.1.9

You are using CFM 1.x on CDH

If you are using CFM 1.x on CDH 5 or CDH 6, or as standalone CFM, and you want to upgrade to a higher version of CFM, there are specific upgrade paths that you can take. Compare the different upgrade options in the Upgrade and migration paths diagram and see both migration and upgrade processes in the following table:

Table 2. Upgrade procedure options from CFM 1.x
Migration Upgrade from CFM 1.x on CDH 6 Upgrade from CFM 1.x on CDH 5 Upgrade from standalone CFM 1.x
Step 1. Upgrade CFM 1.0.0 to CFM 1.1.0 Upgrade CFM 1.0.1 to CFM 1.1.0 Upgrade CFM 1.0.0 to CFM 1.1.0 Upgrade CFM 1.0.1 to CFM 1.1.0 Upgrade CFM 1.0.0 to CFM 1.1.0 Upgrade CFM 1.0.1 to CFM 1.1.0 Upgrade CFM 1.0.0 to CFM 1.1.0 Upgrade CFM 1.0.1 to CFM 1.1.0
Step 2. Install CFM 2.x on CDP Private Cloud Base 7.1.1 - 7.1.8 Upgrade CDH 6 to CDP Private Cloud Base 7.1.7, 7.1.7 SP1 or 7.1.7 SP2 Upgrade CDH/CM 5.0-5.12 to CDH/CM 5.13 or higher.

See also the Cloudera Enterprise Upgrade Guide.

Upgrade CFM 1.1.0 to CFM 2.x
Step 3. Migrate data from CFM 1.x to CFM 2.x Upgrade from CFM 1.1.0 to CFM 2.x Upgrade CDH 5.13 or higher to CDP Private Cloud Base 7.1.1 or 7.1.7
Step 4. Upgrade CFM 1.1.0 to CFM 2.x

For an explanation on the differences between upgrade and migration, see CFM upgrade and migration options.

You are using HDF

If you are using HDF and you want to upgrade to CFM, there are specific upgrade paths that you can take. Compare the different upgrade options in the Upgrade and migration paths diagram and see both migration and in-place upgrade processes in the following table:

Table 3. Upgrade procedure options from HDF
Migration In-place upgrade
Step 1. Upgrade HDF to 3.5.x.

See also the HDF 3.5.2 Release Notes.

Upgrade HDF to 3.5.2.

See also the HDF 3.5.2 Release Notes.

Step 2. Install CFM 2.x on CDP Private Cloud Base 7.1.1 - 7.1.8 In-place upgrade HDF 3.5.2 to CFM 2.1.1 on CDP Private Cloud Base 7.1.6 or CFM 2.1.2-2.1.4 on CDP Private Cloud Base 7.1.7.
Step 3. Migrate data from HDF to CFM

For an explanation on the differences between in-place upgrade and migration, see CFM upgrade and migration options.

CFM upgrade and migration options

There are three methods to change from an older version to CFM 2.x.

Upgrade
Upgrade refers to a full upgrade of CFM on CDP Private Cloud Base without the need of having to migrate data between clusters. For detailed information on performing an upgrade, see Upgrading from CFM 2.x and Upgrading from CFM 1.x.
Possible paths:
  • CFM 1.1.0 > CFM 2.x
  • CFM 2.x > CFM 2.x
Migration
Data migration refers to moving existing HDF or CFM 1.x cluster workloads to a new installation of CDP Private Cloud Base. You can move your NiFi dataflows and NiFi Registry versioned flows from an HDF 3.5.x or CFM 1.1.0 (standalone, or on CDH 5 or CDH 6) cluster to a CFM 2.x cluster on CDP Private Cloud Base. It requires that you have both your HDF or CFM 1.1.0 clusters and a CFM 2.x cluster running at the same time. Cloudera recommends migration over in-place upgrade. For detailed information on performing migration, see Migration from HDF 3.5.x or CFM 1.x.
Possible paths:
  • HDF 3.5.x > CFM 2.x
  • CFM 1.1.0 > CFM 2.x
In-place upgrade
This option enables you to install Cloudera Manager when using HDF and allows Cloudera Manager to take over the management of your services. You can convert your existing Ambari blueprint to a Cloudera Manager Deployment template using the AM2CM tool. Cloudera recommends migration over in-place upgrade. If you have a version of HDF lower than 3.5.2.0, first upgrade to HDF 3.5.2.0 and then upgrade HDF to CFM 2.1.1-2.1.4 on CDP Private Cloud Base 7.1.6 or 7.1.7. For detailed information on performing an in-place upgrade, see In-place upgrade from HDF 3.5.x.
Possible paths:
  • HDF 3.5.2.0 > CFM 2.1.1 on CDP 7.1.6
  • HDF 3.5.2.0 > CFM 2.1.1-2.1.5 on CDP 7.1.7