Streams Replication Manager Service data traffic reference
The Streams Replication Manager Service generates data traffic when it collects replication related metrics. Data traffic is generated between the Streams Replication Manager Service and its target Kafka cluster. Additionally, if Remote Querying is set up, data traffic is also generated between different Streams Replication Manager Services that are remote to each other. Review these examples to gain a better understanding of how much data traffic you should expect in your deployment.
- Data transferred between the Streams Replication Manager Service and Kafka
- The Streams Replication Manager service generates data traffic between itself
and its target Kafka cluster. This data traffic is generated as a result of the Streams Replication Manager Service collecting the raw metrics from the target
Kafka cluster. In the case of:
- A single replication.
- A single replicated topic with 1000 partitions and 100 messages published per second.
- A single consumer group.
- Data transferred between Streams Replication Manager Services by Remote Querying
- When Remote Querying is enabled, the Streams Replication Manager Service
acting as the designated monitoring gateway generates additional data traffic. This data
traffic is generated as a result of the gateway communicating with other, remote Streams Replication Manager Services and receiving data on remote replications. In
the case of:
- A single replication flow.
- A single replicated topic with 1000 partitions.
- A single consumer group.
- One hour retention time set for the Streams application.
The maximum amount of data traffic generated by Remote Querying (the data returned by other Streams Replication Manager Services) is around 70 kB.
