Auto-scaling flow deployments
Flow deployments can be configured to automatically scale up or down the number of NiFi nodes depending on the resource utilization in the cluster.
With Auto-scaling, you get the following benefits:
-
You can choose a minimum and maximum number of nodes to ensure that the required resources are available while controlling cost.
-
Flow deployments support CPU based auto-scaling as well as flow metrics based auto-scaling.
-
When a flow deployment scales down, the affected NiFi nodes are being offloaded before they are removed from the cluster to ensure that no data is lost.
-
After new nodes have been added to the cluster, new data is automatically distributed to all cluster nodes including the recently provisioned ones.