Cloudera Docs

Scaling KRaft

Learn how to scale KRaft nodes (KRaft Controllers) in a Streams Messaging cluster by resizing the KRaft host group.

When you add or remove KRaft nodes, the cluster automatically adds or removes the corresponding KRaft Controllers from the quorum. You do not run separate quorum membership commands in Cloudera Manager. Scale KRaft by adding nodes to or removing nodes from the KRaft Nodes host group using the Resize action in Cloudera Data Hub.

  • Ensure that the cluster, its hosts, and all its services are healthy.
  • Ensure that the Kafka brokers and KRaft Controllers are commissioned and running.
  • The KRaft quorum sync feature uses the Cloudera Manager property controller.quorum.auto.join.enable (Enable Controller Quorum Auto Join) on KRaft Controller roles. This setting is enabled by default on supported versions.
  1. Log in to the Cloudera web interface.
  2. Go to Management Console > Data Hub Clusters.
  3. Find and select the cluster you want to scale.
  4. Click Actions > Resize.
  5. Select the kraft host group.
  6. Set the desired size of the host group.
    Ensure that you set an odd number of nodes.
  7. Optional: If you are upscaling the cluster, select an Adjustment type based on your requirements.
  8. Optional: If you are downscaling the cluster, select Force downscale to forcibly remove hosts.
  9. Click Resize.
  10. Wait until the resize operation completes and the cluster is healthy.
  11. Verify that all KRaft Controller roles are healthy and that the quorum reflects the new controller count.
    For more information, see Troubleshooting KRaft controller scaling.
The KRaft host group is resized and the KRaft quorum membership matches the new controller count.