Scaling up Kafka Connect
Learn how you can upscale Kafka Connect in a Streams Messaging cluster.
Kafka Connect in a Streams Messaging cluster can be upscaled. The upscale operation differs depending on which Streams Messaging cluster template you are using. In the Light Duty template Kafka Connect is upscaled by adding nodes to the Broker host group. In the Heavy Duty template, Kafka Connect is upscaled by adding nodes to the Connect host group.
- Ensure that you have reviewed Scaling Kafka Connect.
- Ensure that the cluster, its hosts, and all its services are healthy.
- Ensure that the Kafka brokers are commissioned and running.
- If using the Light Duty cluster template, ensure that the Cruise Control service is
running.
This is required because in the Light Duty template, Kafka Connect is deployed on the same node as Kafka brokers. While Kafka Connect does not require Cruise Control for scaling, Kafka brokers do.