Upgrade and migration paths
Cloudera encourages you to run NiFi on Cloudera Data Platform (CDP) so that you can take advantage of the latest updates and features. You can run NiFi on CDP by installing the CFM parcel on top of CDP. You can upgrade or migrate from earlier versions of CFM on CDP Private Cloud Base or from HDF and CFM on CDH. Review the upgrade and migration information to ensure that you are aware of the requirements pertaining to the upgrade or migration scenario appropriate to your use case.
Upgrade and migration paths overview
You are using CFM 2.x on CDP Private Cloud Base
If you are using CFM 2.x on CDP Private Cloud Base 7.1.1-7.1.9, and you want to upgrade to a higher version of CFM, there are specific upgrade paths that you need to take. Review them in the Upgrade and migration paths diagram and see the procedure steps in the following table:
| Upgrade | |
|---|---|
| Step 1. | Upgrade CFM to 2.0.4 if you are using CFM 2.0.1 |
| Step 2. | Upgrade CDP Private Cloud Base to 7.1.7, 7.1.7 SP1, or 7.1.7 SP2 |
| Step 3. |
Check the Upgrade and migration paths diagram to identify the sequence of intermediate upgrades required to transition from your current CFM version to the desired one. Upgrade to CFM 2.1.5 from CFM 2.x |
| Step 4. | Upgrade CDP Private Cloud Base to 7.1.8 or 7.1.9 |
You are using CFM 1.x on CDH
If you are using CFM 1.x on CDH 5 or CDH 6, or as standalone CFM, and you want to upgrade to a higher version of CFM, there are specific upgrade paths that you can take. Compare the different upgrade options in the Upgrade and migration paths diagram and see both migration and upgrade processes in the following table:
| Migration | Upgrade from CFM 1.x on CDH 6 | Upgrade from CFM 1.x on CDH 5 | Upgrade from standalone CFM 1.x | |||||
|---|---|---|---|---|---|---|---|---|
| Step 1. | Upgrade CFM 1.0.0 to CFM 1.1.0 | Upgrade CFM 1.0.1 to CFM 1.1.0 | Upgrade CFM 1.0.0 to CFM 1.1.0 | Upgrade CFM 1.0.1 to CFM 1.1.0 | Upgrade CFM 1.0.0 to CFM 1.1.0 | Upgrade CFM 1.0.1 to CFM 1.1.0 | Upgrade CFM 1.0.0 to CFM 1.1.0 | Upgrade CFM 1.0.1 to CFM 1.1.0 |
| Step 2. | Install CFM 2.x on CDP Private Cloud Base 7.1.1 - 7.1.8 | Upgrade CDH 6 to CDP Private Cloud Base 7.1.7, 7.1.7 SP1 or 7.1.7 SP2 | Upgrade CDH/CM 5.0-5.12 to CDH/CM 5.13 or
higher. See also the Cloudera Enterprise Upgrade Guide. |
Upgrade CFM 1.1.0 to CFM 2.x | ||||
| Step 3. | Migrate data from CFM 1.x to CFM 2.x | Upgrade from CFM 1.1.0 to CFM 2.x | Upgrade CDH 5.13 or higher to CDP Private Cloud Base 7.1.1 or 7.1.7 | |||||
| Step 4. | Upgrade CFM 1.1.0 to CFM 2.x | |||||||
For an explanation on the differences between upgrade and migration, see CFM upgrade and migration options.
You are using HDF
If you are using HDF and you want to upgrade to CFM, there are specific upgrade paths that you can take. Compare the different upgrade options in the Upgrade and migration paths diagram and see both migration and in-place upgrade processes in the following table:
| Migration | In-place upgrade | |
|---|---|---|
| Step 1. | Upgrade HDF to 3.5.x. See also the HDF 3.5.2 Release Notes. |
Upgrade HDF to 3.5.2. See also the HDF 3.5.2 Release Notes. |
| Step 2. | Install CFM 2.x on CDP Private Cloud Base 7.1.1 - 7.1.8 | In-place upgrade HDF 3.5.2 to CFM 2.1.1 on CDP Private Cloud Base 7.1.6 or CFM 2.1.2-2.1.4 on CDP Private Cloud Base 7.1.7. |
| Step 3. | Migrate data from HDF to CFM |
For an explanation on the differences between in-place upgrade and migration, see CFM upgrade and migration options.
CFM upgrade and migration options
There are three methods to change from an older version to CFM 2.x.
- Upgrade
- Upgrade refers to a full upgrade of CFM on CDP Private Cloud Base without the need of having to migrate data between clusters. For detailed information
on performing an upgrade, see Upgrading from CFM 2.x and Upgrading from CFM 1.x.Possible paths:
- Migration
- Data migration refers to moving existing HDF or CFM 1.x cluster workloads to a new
installation of CDP Private Cloud Base. You can move your NiFi
dataflows and NiFi Registry versioned flows from an HDF 3.5.x or CFM 1.1.0 (standalone,
or on CDH 5 or CDH 6) cluster to a CFM 2.x cluster on CDP Private Cloud Base. It requires that you have both your HDF or
CFM 1.1.0 clusters and a CFM 2.x cluster running at the same time. Cloudera recommends
migration over in-place upgrade. For detailed information on performing migration, see
Migration from HDF 3.5.x or CFM 1.x.Possible paths:
- In-place upgrade
- This option enables you to install Cloudera Manager when using HDF and allows Cloudera
Manager to take over the management of your services. You can convert your existing
Ambari blueprint to a Cloudera Manager Deployment template using the AM2CM tool.
Cloudera recommends migration over in-place upgrade. If you have a version of HDF lower
than 3.5.2.0, first upgrade to HDF 3.5.2.0 and then upgrade HDF to CFM 2.1.1-2.1.4 on
CDP Private Cloud Base 7.1.6 or 7.1.7. For detailed information
on performing an in-place upgrade, see In-place upgrade from HDF 3.5.x.Possible paths:
