Upgrade and migration paths
Cloudera encourages you to run NiFi on Cloudera Data Platform (CDP) so that you can take advantage of the latest updates and features. You can run NiFi on CDP by installing the CFM parcel on top of CDP. You can upgrade or migrate from HDF, CFM on CDH, or earlier versions of CFM on CDP Private Cloud Base. Review the upgrade and migration information to ensure that you are aware of the requirements pertaining to the upgrade or migration scenario appropriate to your use case.
Upgrade paths diagram
You are using CFM 2.x on CDP Private Cloud Base
If you are using CFM 2.x on CDP Private Cloud Base 7.1.1-7.1.8, and you want to upgrade to a higher version of CFM, there are specific upgrade paths that you need to take. Review them in the Upgrade paths diagram and see the procedure steps in the following table:
| Upgrade | |
|---|---|
| Step 1. | Upgrade CFM to 2.0.4 if you are using CFM 2.0.1 |
| Step 2. | Upgrade CDP Private Cloud Base to 7.1.7, 7.1.7 SP1, or 7.1.7 SP2 |
| Step 3. | Upgrade CFM to a higher version |
| Step 4. | Upgrade CDP Private Cloud Base to 7.1.8 |
You are using CFM 1.x on CDH
If you are using CFM 1.x on CDH 5 or CDH 6, or as standalone CFM, and you want to upgrade to a higher version of CFM, there are specific upgrade paths that you can take. Compare the different upgrade options in the Upgrade paths diagram and see both migration and upgrade processes in the following table:
| Migration | Upgrade from CFM 1.x on CDH 6 | Upgrade from CFM 1.x on CDH 5 | Upgrade from standalone CFM 1.x | |||||
|---|---|---|---|---|---|---|---|---|
| Step 1. | Upgrade CFM 1.0.0 to CFM 1.1.0 | Upgrade CFM 1.0.1 to CFM 1.1.0 | Upgrade CFM 1.0.0 to CFM 1.1.0 | Upgrade CFM 1.0.1 to CFM 1.1.0 | Upgrade CFM 1.0.0 to CFM 1.1.0 | Upgrade CFM 1.0.1 to CFM 1.1.0 | Upgrade CFM 1.0.0 to CFM 1.1.0 | Upgrade CFM 1.0.1 to CFM 1.1.0 |
| Step 2. | Install CFM 2.x on CDP Private Cloud Base 7.1.1 - 7.1.8 | Upgrade CDH 6 to CDP Private Cloud Base 7.1.7, 7.1.7 SP1, or 7.1.7 SP2 | Upgrade CDH/CM 5.0-5.12 to CDH/CM 5.13 or higher. See also the Cloudera Enterprise Upgrade Guide. | Upgrade CFM to 2.x | ||||
| Step 3. | Migrate data from CFM 1.x to CFM 2.x | Upgrade CFM to 2.x | Upgrade CDH 5.13 or higher to CDP Private Cloud Base 7.1.1 or 7.1.7 | |||||
| Step 4. | Upgrade CFM to 2.x | |||||||
For an explanation on the differences between upgrade and migration, see CFM upgrade and migration options.
You are using HDF
If you are using HDF and you want to upgrade to CFM, there are specific upgrade paths that you can take. Compare the different upgrade options in the Upgrade paths diagram and see both migration and in-place upgrade processes in the following table:
| Migration | In-place upgrade | |
|---|---|---|
| Step 1. | Upgrade HDF to 3.5.x. See also the HDF 3.5.2 Release Notes. |
Upgrade HDF to 3.5.2. See also the HDF 3.5.2 Release Notes. |
| Step 2. | Install CFM 2.x on CDP Private Cloud Base 7.1.1 - 7.1.8 | In-place upgrade HDF 3.5.2 to CFM 2.1.1 on CDP Private Cloud Base 7.1.6 or CFM 2.1.2-2.1.4 on CDP Private Cloud Base 7.1.7. |
| Step 3. | Migrate data from HDF to CFM |
For an explanation on the differences between in-place upgrade and migration, see CFM upgrade and migration options.
CFM upgrade and migration options
There are three methods to change from an older version to CFM 2.x.
- Upgrade
- Upgrade refers to a full upgrade of CFM on CDP Private Cloud Base without the need of having to migrate data between clusters. For detailed information
on performing an upgrade, see Upgrading from CFM 2.x and Upgrading from CFM 1.x.Possible paths:
- Migration
- Data migration refers to moving existing HDF or CFM 1.x cluster workloads to a new
installation of CDP Private Cloud Base. You can move your NiFi
dataflows and NiFi Registry versioned flows from an HDF 3.5.x or CFM 1.1.0 (standalone,
or on CDH 5 or CDH 6) cluster to a CFM 2.x cluster on CDP Private Cloud Base. It requires that you have both your HDF or
CFM 1.1.0 clusters and a CFM 2.x cluster running at the same time. Cloudera recommends
migration over in-place upgrade. For detailed information on performing migration, see
Migration from HDF 3.5.x or CFM 1.x.Possible paths:
- In-place upgrade
- This option enables you to install Cloudera Manager when using HDF and allows Cloudera
Manager to take over the management of your services. You can convert your existing
Ambari blueprint to a Cloudera Manager Deployment template using the AM2CM tool.
Cloudera recommends migration over in-place upgrade. If you have a version of HDF lower
than 3.5.2.0, first upgrade to HDF 3.5.2.0 and then upgrade HDF to CFM 2.1.1-2.1.4 on
CDP Private Cloud Base 7.1.6 or 7.1.7. For detailed information
on performing an in-place upgrade, see In-place upgrade from HDF 3.5.x.Possible paths:
