This guide explains how you can remove nodes from your NiFi cluster for cost
optimization. Especially, when data processing demands decrease. Scaling down helps save
infrastructure resources while maintaining data integrity.
Ensure your NiFi flow is running and stable before starting the scale-down process.
Log into the CDP Public Cloud UI.
Go to Management Console > Environments.
Select the Data Hub cluster where your NiFi flow is running.
Optional: Open the NiFi UI by clicking the NiFi link to verify the
current number of nodes in your cluster.
In the CDP UI, click Actions > Resize.
The Cluster Resize window appears.
Select the appropriate hostgroup from the dropdown, increase the number of
nodes by clicking the + icon, and then click
Resize.
Use nifi_scaling for light-duty templates.
Use nifi for heavy-duty templates.
Increase the number of nodes by clicking the - icon,
then click Resize.
The scaling operation will begin and may take several minutes.
The following happens during scale-down:
The nodes selected for removal are disconnected from the NiFi
cluster.
Data processing on these nodes is stopped.
The data stored on the nodes being removed is migrated to the
remaining nodes of the cluster to prevent data loss.
The NiFi service on the nodes being removed is stopped.
The underlying virtual machines on the nodes being removed are
stopped and deleted.
Optional: Go to the NiFi UI to check that the nodes are successfully removed from the
NiFi cluster:
The scale down event is fully complete only when the removed nodes are no
longer listed in the Hardware tab of the Data
Hub Clusters page, as shown in the following image:
You have now successfully scaled down your NiFi cluster.
