Upgrade and migration paths

Cloudera encourages you to run NiFi on Cloudera Data Platform (CDP) so that you can take advantage of the latest updates and features. You can run NiFi on CDP by installing the CFM parcel on top of CDP. You can upgrade or migrate from HDF, CFM on CDH, or earlier versions of CFM on CDP Private Cloud Base. Review the upgrade and migration information to ensure that you are aware of the requirements pertaining to the upgrade or migration scenario appropriate to your use case.

Upgrade paths diagram

You are using CFM 2.x on CDP Private Cloud Base

If you are using CFM 2.x on CDP Private Cloud Base 7.1.1-7.1.8, and you want to upgrade to a higher version of CFM, there are specific upgrade paths that you need to take. Review them in the Upgrade paths diagram and see as follows:

Table 1. Upgrade procedure from CFM 2.x
Upgrade
Step 1. Upgrade CFM to 2.0.4
Step 2. Upgrade CDP Private Cloud Base to 7.1.7 or 7.1.7 SP1
Step 3. Upgrade CFM to a higher version
Step 4. Upgrade CDP Private Cloud Base to 7.1.8

You are using CFM 1.x on CDH

If you are using CFM 1.x on CDH 5 or CDH 6, or as standalone CFM, and you want to upgrade to a higher version of CFM, there are specific upgrade paths that you can take. Compare the different upgrade options in the Upgrade paths diagram and see both migration and upgrade processes as follows:

Table 2. Upgrade procedure options from CFM 1.x
Migration Upgrade from CFM 1.x on CDH 6 Upgrade from CFM 1.x on CDH 5 Upgrade from standalone CFM 1.x
Step 1. Upgrade CFM 1.0.0 to CFM 1.1.0 Upgrade CFM 1.0.1 to CFM 1.1.0 Upgrade CFM 1.0.0 to CFM 1.1.0 Upgrade CFM 1.0.1 to CFM 1.1.0 Upgrade CFM 1.0.0 to CFM 1.1.0 Upgrade CFM 1.0.1 to CFM 1.1.0 Upgrade CFM 1.0.0 to CFM 1.1.0 Upgrade CFM 1.0.1 to CFM 1.1.0
Step 2. Install CFM 2.x on CDP Private Cloud Base 7.1.1 - 7.1.8 Upgrade CDH 6 to CDP Private Cloud Base 7.1.7 or 7.1.7 SP1 Upgrade CDH/CM 5.0-5.12 to CDH/CM 5.13 or higher. See also Cloudera Enterprise Upgrade Guide. Upgrade CFM to 2.x
Step 3. Migrate data from CFM 1.x to CFM 2.x Upgrade CFM to 2.x Upgrade CDH 5.13 or higher to CDP Private Cloud Base 7.1.1 or 7.1.7
Step 4. Upgrade CFM to 2.x

For an explanation on the differences between upgrade and migration options, see CFM upgrade and migration options.

You are using HDF

If you are using HDF and you want to upgrade to CFM, there are specific upgrade paths that you can take. Compare the different upgrade options in the Upgrade paths diagram and see both migration and in-place upgrade processes as follows:

Table 3. Upgrade procedure options from HDF
Migration In-place upgrade
Step 1. Upgrade HDF to 3.5.x. See also HDF 3.5.2 Release Notes. Upgrade HDF to 3.5.2 . See also HDF 3.5.2 Release Notes.
Step 2. Install CFM 2.x on CDP Private Cloud Base 7.1.1 - 7.1.8 In-place upgrade HDF 3.5.2 to CFM 2.1.1 on CDP Private Cloud Base 7.1.6 or CFM 2.1.2-2.1.4 on CDP Private Cloud Base 7.1.7.
Step 3. Migrate data from HDF to CFM

For an explanation on the differences between in-place upgrade and migration options, see CFM upgrade and migration options.

CFM upgrade and migration options

There are three methods to change from an older version to CFM 2.x.

Upgrade
Upgrade refers to a full upgrade of CFM on CDP Private Cloud Base without the need of having to migrate data between clusters. For detailed information on performing an upgrade, see Upgrading from CFM 2.x and Upgrading from CFM 1.x.
Possible paths:
  • CFM 1.1.0 > CFM 2.x
  • CFM 2.x > CFM 2.x
Migration
Data migration refers to moving existing HDF or CFM 1.x cluster workloads to a new installation of CDP Private Cloud Base. You can move your NiFi dataflow and NiFi Registry versioned flows from an HDF 3.5.x or CFM 1.1.0 (standalone, or on CDH 5 or CDH 6) cluster to a CFM 2.x cluster on CDP Private Cloud Base. It requires that you have both your HDF or CFM 1.1.0 cluster and a CFM 2.x cluster running at the same time. Cloudera recommends migration over in-place upgrade. For detailed information on performing migration, see Migration from HDF 3.5.x or CFM 1.x.
Possible paths:
  • HDF 3.5.x > CFM 2.x
  • CFM 1.1.0 > CFM 2.x
In-place upgrade
This option allows you to install Cloudera Manager when using HDF and allows it to take over the management of your services. You can convert your existing Ambari blueprint to Cloudera Manager Deployment template using the AM2CM tool. Cloudera recommends migration over in-place upgrade. If you have a version of HDF lower than 3.5.2.0, then first upgrade to HDF 3.5.2.0 and then upgrade HDF to CFM 2.1.1-2.1.4 on CDP Private Cloud Base 7.1.6 or 7.1.7. For detailed information on performing in-place upgrade, see In-place upgrade from HDF 3.5.x.
Possible paths:
  • HDF 3.5.2.0 > CFM 2.1.1 on CDP 7.1.6
  • HDF 3.5.2.0 > CFM 2.1.1-2.1.4 on CDP 7.1.7