Backup Kafka

Before you begin the upgrade process, you need to explicitly set the Kafka protocol version to match what's being used currently among the brokers and clients. Update server.properties on all brokers as follows:

  1. Log in to Ambari.
  2. Choose the Kafka service.
  3. Select the Configs page.
  4. Find the Custom kafka-broker section.
  5. Add the following properties:
    • inter.broker.protocol.version=current_Kafka_version
    • log.message.format.version=current_Kafka_version

    Replace current_Kafka_version with the version of Apache Kafka currently being used, in case of HDP 3.1.5 it is 2.0.0.

  6. Save your changes. The information is automatically copied to each broker.