CDH 6 includes Apache Kafka as part of the core package. The documentation includes improved contents for how to set up, install, and administer your Kafka ecosystem. For more information, see the Cloudera Enterprise 6.0.x Apache Kafka Guide. We look forward to your feedback on both the existing and new documentation.

Additional Considerations When Using Apache Kafka

When using Apache Kafka, consider the following:
  • Use Cloudera Manager to start and stop Kafka and ZooKeeper services. Do not use the kafka-server-start, kafka-server-stop, zookeeper-server-start, and zookeeper-server-stop commands.
  • All Kafka command-line tools are located in /opt/cloudera/parcels/KAFKA/lib/kafka/bin/.
  • Ensure that the JAVA_HOME environment variable is set to your JDK installation directory before using the command-line tools. For example: 
    export JAVA_HOME=/usr/java/jdk1.7.0_55-cloudera

See the Apache Kafka documentation.

See the Apache Kafka FAQ.

See Kafka code examples.