Hortonworks Docs » Data Platform 3.1.0 » Installing and configuring Apache Kafka

Installing and configuring Apache Kafka

Also available as:

PDF

loading table of contents...

Installing Kafka
- Prerequisites
- Installing Kafka Using Ambari
Configuring Kafka for a Production Environment

Kafka Broker Settings

The following subsections describe configuration settings that influence the performance of Kafka brokers.

Connection Settings
Review the following connection setting in the Advanced kafka-broker category, and modify as needed:
Topic Settings
For each topic, Kafka maintains a structured commit log with one or more partitions. These topic partitions form the basic unit of parallelism in Kafka. In general, the more partitions there are in a Kafka cluster, the more parallel consumers can be added, resulting in higher throughput.
Log Settings
Review the following settings in the Kafka Broker category, and modify as needed:
Compaction Settings
Review the following settings in the Advanced kafka-broker category, and modify as needed:
General Broker Settings
Review the following settings in the Advanced kafka-broker category, and modify as needed:

Parent topic: Configuring Kafka for a Production Environment

© 2012–2019, Hortonworks, Inc.

Document licensed under the Creative Commons Attribution ShareAlike 4.0 License.

Hortonworks.com | Documentation | Support | Community