Non-Ambari Cluster Installation Guide
Also available as:
PDF
loading table of contents...

Configure Kafka

Use the following procedure to configure Kafka.

  1. By default, Kafka is installed at /usr/hdp/current/kafka-broker.

  2. Verify the values of the following configuration properties in the server.properties file:

Table 20.1. Kafka Configuration Properties

Kafka Configuration Property

Description

broker.id

Each Kafka broker requires a unique integer as an identifier. The default value is 0.

port

The port to which the Kafka socket server listens. The default value is 9092.

log.dirs

Comma-separated list of directories where Kafka log files are stored. The default value is /tmp/kafka-logs.

zookeeper.connect

The hostname or IP address of the host running ZooKeeper and the port to which ZooKeeper listens. The default value is localhost:2181.

log.retention.hours

The number of hours to wait before a Kafka log file is eligible for deletion. The default value is 168 hours (7 days).

Listeners

listener - Comma-separated list of URIs we will listen on and their protocols.

Specify hostname as 0.0.0.0 to bind to all interfaces.

Leave hostname empty to bind to default interface.

Examples of legal listener lists:

PLAINTEXT://myhost:9092,PLAINTEXTSASL://:9091

PLAINTEXT://0.0.0.0:9092, PLAINTEXTSASL://localhost:9093