Auto-scaling flow deployments

Flow deployments can be configured to automatically scale up or down the number of NiFi nodes depending on the resource utilization in the cluster.

With Auto-scaling, you get the following benefits:

  • You can choose a minimum and maximum number of nodes to ensure that the required resources are available while controlling cost.

  • Flow deployments support CPU based auto-scaling as well as flow metrics based auto-scaling.

  • When a flow deployment scales down, the affected NiFi nodes are being offloaded before they are removed from the cluster to ensure that no data is lost.

  • After new nodes have been added to the cluster, new data is automatically distributed to all cluster nodes including the recently provisioned ones.