Command Line Upgrade
Also available as:
PDF
loading table of contents...

Upgrade Apache Kafka

Upgrade each Apache Kafka node one at a time. You can stop each Kafka broker and upgrade the component without downtime if you have enough replication for your topic.

  1. Shut down the current Kafka daemon, switch to the new version, and start the daemon:

    su - kafka -c "/usr/hdp/current/kafka-broker/bin/kafka stop"
    hdp-select set kafka-broker 2.3.4.0-2633
    su - kafka -c "usr/hdp/current/kafka-broker/bin/kafka start"
  2. To verify that the Kafka daemon joined the cluster, create a topic and submit it to Kafka. Send a test message for that topic, and then validate that it was received by a consumer.

  3. If the upgrade process fails, follow the steps in "Downgrading Kafka" to return to your previous version of Kafka.