Cloudera Docs

CFM upgrade and migration paths

Cloudera encourages you to run NiFi on Cloudera Data Platform (CDP) so that you can take advantage of the latest updates and features. You can run NiFi on CDP by installing the CFM parcel on top of CDP. You can upgrade or migrate from HDF, CFM on CDH, or earlier versions of CFM on CDP Private Cloud Base. Review the upgrade and migration information to ensure that you are aware of the requirements pertaining to the upgrade or migration scenario appropriate to your use case.

You are using HDF

HDF 3.5.2 is based on Apache NiFi 1.12.1 and ensures differences between NiFi included in HDF and CFM are minimal. For information on upgrading to HDF 3.5.2, see the following HDF 3.5.2 documentation links in the Related information section below.

  • Release Notes for HDF 3.5.2

  • Ambari Managed HDF Upgrade

From HDF 3.5.2, you have two options to migrate to CFM on CDP Private Cloud Base:

  • Migration

    Migration is the less disruptive option but requires that you have both a CFM cluster and the HDF cluster running at the same time. For migration instructions, review the following documentation links in the Related information section below.

    • HDF to CFM in CDP Private Cloud Base Migration
    • Use case examples on how to migrate flows from HDF to CFM with no downtime
    • No Data Loss and No Service Interruption -- HDF to CFM Rolling Migration

  • In-place migration

    This option allows you to install Cloudera Manager and have it taking over the management of your services.

    You can use the AM2CM 1.2.1 migration tool to migrate to CFM 2.1.1 installed on CDP Private Cloud Base 7.1.6, from:

    • Ambari 2.7.5 + HDF 3.5.2

    • or Ambari 2.7.5 + HDP 3.1.5 + HDF 3.5.2

You are using CFM 1.x on CDH 5

If you are running CFM on CDH today, your first step to migrating to CFM on CDP is to ensure that you are running CFM 1.1.0. If not, you must upgrade before performing any other operation. See Upgrading to CFM 1.1.0 in the Related information section for further details.

Once you are running CFM 1.1.0, you must perform two steps to run CFM on CDP Private Cloud Base.

  1. Upgrade Cloudera Manager and CDH. Review the Upgrading CDH to CDP Private Cloud Base in the Related information section below, for more information. It explains how to first upgrade Cloudera Manager, and then upgrade the cluster.
  2. Upgrade CFM from 1.1.0 to 2.x. See Upgrading to CFM 2.1.1 from CFM 1.1.0 in the Related information section for more information.

You are using CFM 1.x on CDH 6

Upgrading from CDH 6 to CDP is not available at the time of the CFM 2.1.2 release.

You are using CFM 2.x on CDP Private Cloud Base

If you are already using CFM on CDP Private Cloud Base and you want to upgrade to the latest version of CFM, there are specific upgrade paths that you can take. Review these paths carefully before planning for an upgrade.

  • If you are running CFM 2.0.1 on CDP 7.1.1, you must first upgrade the CFM parcel to CFM 2.0.4 before upgrading to a more recent version of CDP. See Upgrading to 2.1.1 from CFM 2.0.1 in the Related information section below for more information.

  • If you are running CFM 2.0.4 on CDP Private Cloud Base version 7.1.1 through version 7.1.5 and you want to get to CFM 2.1.1, you must first upgrade to CDP 7.1.6. See Upgrading CDP Private Cloud base to a higher version in the Related information section for more information.