Tune Batch Indexing Kafka Partitions
The first batch indexing variable that should be determined is the minimum number of Kafka partitions required.
Use the following formula to determine the minimum number of Kafka partitions for the enrichment topology
Num Partitions=Max( t/p,t/c)
tis the desired throughput
pis the maximum throughout using a single producer
cis the maximum throughput using a single consumer