Cloudera Docs

Cruise Control REST API endpoints

You can configure and check the status of Cruise Control using the REST API with GET and POST endpoints. You must be aware of the required action or query, and submit a curl command in the command line to use the Cruise Control REST API.

There are two types of REST endpoints for Cruise Control: GET and POST .

With GET endpoints, you can query information about the rebalancing process, the status of Cruise Control and Kafka brokers. The GET endpoints are read-only operations, and do not have any impact on Cruise Control, Kafka, or the rebalancing process.

You can use the POST endpoints to change the rebalancing process, modify the number of Kafka brokers, configure Cruise Control, and customize certain sampling and proposal tasks.

In the command line, you need to create the POST or GET commands with curl, and also include the Cruise Control hostname, port, and the required endpoint.
curl -X GET "http://<cruise_control_hostname>:8899/kafkacruisecontrol/kafka_cluster_state”
curl -X POST “http://<cruise_control_hostname>:8899/kafkacruisecontrol/add_broker?brokerid=24”

The following table summarizes the available operations for GET and POST endpoints. The description column only provides a brief summary of the endpoints. For the detailed description of the Cruise Control REST API, see the official REST API documentation.

Endpoint Action Description
/kafkacruisecontrol/state You can query the state of Kafka Cruise Control. This includes the state of monitor, executor, analyzer, and anomaly detector.
/kafkacruisecontrol/load You can query the current cluster load. The Load Monitor needs to be in RUNNING state. This includes the load-per-broker and load-per-host information. Only shows valid partitions with enough metric samples.
/kafkacruisecontrol/partition_load You can query partition resource utilization. The partition load is sorted based on the given resource.
/kafkacruisecontrol/kafka_cluster_state You can query partition and replica state. This includes information for each broker and each partition.
/kafkacruisecontrol/proposals You can query the optimization proposals generated on the workload model. The proposals can be generated based on either the snapshot window or the valid partitions.
/kafkacruisecontrol/user_tasks You can query the user request result. This includes a full list of all the active and completed tasks in Cruise Control.
Endpoint Action Description
/kafkacruisecontrol/rebalance You can trigger a workload balance for a Kafka cluster. Can be based on valid windows or valid partitions. You can specify the goal you want to use.
/kafkacruisecontrol/add_broker?brokerid=[id1,id2...] You can add a list of brokers from a Kafka cluster. Only moves replicas from existing brokers to the newly added brokers. You can choose to throttle the movement of the replica to the newly added broker. The replica movement is throttled on the existing broker.
/kafkacruisecontrol/remove_broker?brokerid=[id1,id2...] You can remove a list of brokers from a Kafka cluster. Only moves partitions from the brokers to be removed to the other existing brokers. You can also specify the destination broker. You can choose to throttle the removed broker during the partition movement.
/kafkacruisecontrol/fix_offline_replicas You can fix offline replicas in a Kafka cluster. If the specified topic has offline replicas, they are still moved to healthy brokers.
/kafkacruisecontrol/demote_broker?brokerid=[id1, id2...] You can move all the leader replicas from a list of brokers. This makes all the replicas on a given broker to be preferred the least, and triggers a preferred leader replica election to migrate the leader replicas off the broker.
/kafkacruisecontrol/demote_broker?brokerid_and_logdirs=[id1-logdir1, id2-logdir2...] You can move all the leader replicas from a list of disks. This makes all the replicas on a given disk to be preferred the least, and triggers a preferred leader replica election to migrate the leader replicas off the disk.
/kafkacruisecontrol/stop_proposal_execution You can stop an ongoing proposal execution task. You can stop a proposal when the execution of a task is still ongoing.
/kafkacruisecontrol/pause_sampling You can pause an ongoing metrics sampling process. The cause of the pause is recorded and shows up when querying the state of Cruise Control.
/kafkacruisecontrol/resume_sampling You can resume a paused metrics load sampling. The cause of the resumption is recorded and shows up when querying the state of Cruise Control.
/kafkacruisecontrol/topic_configuration?topic=[topic_regex]&replication_factor=[target_replication_factor] You can change the replication factor of a topic. Existing replicas are not moved. You can determine which replica should be deleted and which broker should be assigned to the new replica.
/kafkacruisecontrol/admin?disable_self_healing_for=[anomaly_type] You can enable or disable self-healing for Cruise Control. The configuration is only possible with administrator rights.
/kafkacruisecontrol/admin?concurrent_partition_movements_per_broker=[integer] You can increase or decrease the execution concurrency. The configuration is only possible with admininstrator rights.
/kafkacruisecontrol/admin?drop_recently_removed_brokers=[broker_ids] You can drop recently removed or demoted Kafka brokers. The configuration is only possible with administrator rights.