Fine-tuning bulk operation processing
Learn how to configure the Edge Flow Manager (EFM) bulk operation updates. You can find
the related configuration in the efm.properties
file located in the
conf
directory of the EFM installation.
EFM sends updates to agents through operations. The operations can be divided in the following
types:
- Agent level: This is for one individual agent. For example, the Debug request.
- Agent class level: This is for all agents under an agent class. For example, flow update, asset download, property update, and so on.
This documentation describes different configuration scenarios to optimize the agent class level updates.
In order to avoid heavy network loads and prevent Distributed Denial-of-Service (DDoS)-like behavior from agents, the EFM sends updates to agents in smaller batches.
You can find all operation update related configurable parameters in the following
list:
# The maximum number of operations queued to be sent at once efm.operation.monitoring.rollingBatchOperationsSize=100 # The interval for refreshing the operation queue efm.operation.monitoring.rollingBatchOperationsFrequency=10s # The multiplier for agent heartbeat interval properties # to calculate timeout for queued operation efm.operation.monitoring.inQueuedStateTimeoutHeartbeatRate=1.0 # The timeout for deployed, but not done operations efm.operation.monitoring.inDeployedStateTimeout=5m # The interval for checking operation timeouts efm.operation.monitoring.inDeployedStateCheckFrequency=1m # Enable/disable operation timeouts efm.operation.monitoring.enabled=true # Agent heartbeat interval monitor properties # Default value efm.monitor.maxHeartbeatInterval=5m # Class specific values efm.monitor.maxHeartbeatIntervalForClass.[Class\ A]=1m efm.monitor.maxHeartbeatIntervalForClass.[Class\ B]=2m efm.monitor.maxHeartbeatIntervalForClass.[Class\ C]=0m
Let us go through the scenarios one by one and see what can change a given parameter in the example deployment with 10000 agents.