Cloudera Docs

CFM upgrade and migration paths

Cloudera encourages you to run NiFi on Cloudera Data Platform (CDP) so that you can take advantage of the latest updates and features. You can run NiFi on CDP by installing the CFM parcel on top of CDP. You can upgrade or migrate from HDF, CFM on CDH, or earlier versions of CFM on CDP Private Cloud Base. Review the upgrade and migration information to ensure that you are aware of the requirements pertaining to the upgrade or migration scenario appropriate to your use case.

You are using HDF

HDF 3.5.2 is based on Apache NiFi 1.12.1 and ensures differences between NiFi included in HDF and CFM are minimal. For information on upgrading to HDF 3.5.2, see the following HDF 3.5.2 documentation links in the Related information section.

  • Release Notes for HDF 3.5.2

  • Ambari Managed HDF Upgrade

From HDF 3.5.2, you have two options to migrate to CFM on CDP Private Cloud Base:

  • Migration

    Migration is the less disruptive option but requires that you have both a CFM cluster and the HDF cluster running at the same time. For migration instructions, review the following documentation links in the Related information section below.

    • HDF to CFM in CDP Private Cloud Base Migration
    • Use case examples on how to migrate flows from HDF to CFM with no downtime
    • No Data Loss and No Service Interruption -- HDF to CFM Rolling Migration

  • In-place upgrade

    CFM 2.1.1 introduces in-place upgrade. This option allows you to install Cloudera Manager and allows it to take over the management of your services. Review this table to understand the in-place upgrade paths according to your CFM version.
    CFM version AM2CM version CDP Private Cloud Base version Source location
    2.1.2 2.0
    • 7.1.7
    • 7.1.7 SP1
    • 7.1.7 SP2
    • Ambari 2.7.5 + HDF 3.5.2
    • Ambari 2.7.5 + HDP 3.1.5 + HDF 3.5.2
    2.1.1 1.2.1 7.1.6
    • Ambari 2.7.5 + HDF 3.5.2
    • Ambari 2.7.5 + HDP 3.1.5 + HDF 3.5.2

You are using CFM 1.x on CDH

Before you begin the process of upgrading to CFM on CDP Private Cloud Base, please review this table to ensure that you understand the upgrade paths available to you, depending on your version of CDH.

CDH versions CFM versions
CDH 5 2.0.1 and later
CDH 6 2.1.2 and later

If you are running CFM on CDH today, your first step to migrating to CFM on CDP Private Cloud Base is to ensure that you are running CFM 1.1.0. If not, you must upgrade before performing any other operation. See Upgrading to CFM 1.1.0 in the Related information section for further details.

Once you are running CFM 1.1.0, you must perform two steps to run CFM on CDP Private Cloud Base.

  1. Upgrade Cloudera Manager and CDH. See Upgrading CDH to CDP Private Cloud Base in the Related information section for more information. It explains how to first upgrade Cloudera Manager, and then upgrade the cluster.
  2. Upgrade CFM from 1.1.0 to 2.x. See Upgrading to CFM 2.1.2 from CFM 1.1.0 in the Related information section for more information.

You are using CFM on CDP Private Cloud Base

If you are already using CFM on CDP Private Cloud Base and you want to upgrade to the latest version of CFM, there are specific upgrade paths that you can take. Review these paths carefully before planning for an upgrade.

  • If you are running CFM 2.0.1 on CDP 7.1.1, you must first upgrade the CFM parcel to CFM 2.0.4 before upgrading to a more recent version of CDP. See Upgrading to 2.1.2 from CFM 2.0.1 in the Related information section for more information.

  • If you are running CFM 2.0.4 on CDP Private Cloud Base version 7.1.1 through version 7.1.5 and you want to get to CFM 2.1.2, you must first upgrade to CDP 7.1.7 See Upgrading CDP Private Cloud base to a higher version in the Related information section for more information.