CFM installation workflow

Before you start installing Cloudera Flow Management (CFM) on a CDP Private Cloud Base cluster, it is helpful to understand the steps involved. There are three main installation scenarios depending on the type of cluster or clusters on which you install the different components.

The Cloudera Flow Management (CFM) installation workflow consists of preparing your CDP Private Cloud Base cluster and then installing NiFi and NiFi Registry on a base or on a compute cluster, or on a mixed cluster layout. See the following diagram for the procedure steps, and then see the description of each deployment scenario following the diagram.

Link to documentation for preparing your CDP Private Cloud BaseLink to documentation for installing NiFi and NiFi Registry on a Base clusterLink to documentation for installing NiFi and NiFi Registry on a Compute clusterLink to documentation for installing NiFi on a Compute cluster and NiFi Registry on a Base cluster

Scenario 1: NiFi and NiFi Registry on a Base cluster

It is always recommended to install NiFi Registry on your Base cluster. However, in simplified deployment scenarios, for example in trial deployments and simple production scenarios, you can also install NiFi on the Base cluster in order to achieve a single-cluster setup.

A Base cluster is a large cluster that contains SDX services like Ranger and Atlas, as well as compute and storage services like NiFi, Impala, and Hive.

A Base cluster is sometimes called a Regular cluster in Cloudera Manager. It is also known as an SDX cluster, a Shared cluster, or a Data Lake cluster.

Installing NiFi on your Base cluster is a simplified deployment during which you create only one cluster. You can do this if you are deploying one cluster in trial deployments or in simple production scenarios. For information on the installation steps, see Installing NiFi and NiFi Registry on your Base cluster.

When you install both NiFi and NiFi Registry on your Base cluster, your cluster layout will look similar to the following:

Scenario 2: NiFi and NiFi Registry on a Compute cluster

Although it is not a recommended setup, it is possible to install both NiFi and NiFi Registry on a Compute cluster.

A Compute cluster consists exclusively of compute nodes. A Compute cluster is then connected to a Base cluster with SDX services like Ranger and Atlas, using a Shared Data Context.

Installing NiFi on a Compute cluster is recommended when you want to deploy multiple NiFi clusters for larger scale production deployments, when you want to isolate your dataflows, when you want to have different authorization models per dataflow, and other similar deployment scenarios. For information on the installation steps, see Installing NiFi and NiFi Registry on a Compute cluster.

When you install both NiFi and NiFi Registry on a Compute cluster, your cluster layout will look similar to the following:

Scenario 3: NiFi on a Compute cluster and NiFi Registry on a Base cluster

For production deployments, it is the recommended setup to have NiFi installed on one or multiple Compute clusters, while having NiFi Registry installed on the Base cluster.

You can also install NiFi on one or more Compute clusters and NiFi Registry on your Base cluster.

Install NiFi on a Compute cluster and NiFi Registry on your Base cluster when you want to share dataflows across multiple NiFi Compute clusters in your CDP environment. For information on the installation steps, see Installing NiFi on a Compute cluster and NiFi Registry on a Base cluster.

When you install NiFi on one or more Compute clusters, and NiFi Registry on your Base cluster, your cluster layout will look similar to the following: