CDH 6 includes Apache Kafka as part of the core package. The documentation includes improved contents for how to set up, install, and administer your Kafka ecosystem. For more information, see the Cloudera Enterprise 6.0.x Apache Kafka Guide. We look forward to your feedback on both the existing and new documentation.

Issues Fixed in CDK 3.1.1 Powered By Apache Kafka

CDK 3.1.1 Powered By Apache Kafka fixes the following issues:

Shell wrapper script for kafka-configs fails to execute

Running the kafka-configs tool returns a No such file or directory error message.

Workaround: Call the script directly with the following command:
/opt/cloudera/parcels/KAFKA/lib/kafka/bin/kafka-configs.sh

Affected Versions: CDK 3.0.0 and 3.1.0 Powered by Apache Kafka

Fixed Versions: CDK 3.1.1 Powered by Apache Kafka

Cloudera Issue: CDH-61121

Upstream Issues Fixed

The following upstream issues are fixed in CDH 3.1.1:

  • KAFKA-3978 - Ensure high watermark is always positive
  • KAFKA-6593 - Fix livelock with consumer heartbeat thread in commitSync
  • KAFKA-6857 - Leader should reply with undefined offset if undefined leader epoch requested
  • KAFKA-6917 - Process txn completion asynchronously to avoid deadlock
  • KAFKA-6975 - Fix replica fetching from non-batch-aligned log start offset
  • KAFKA-7012 - Don't process SSL channels without data to process
  • KAFKA-7104 - More consistent leader's state in fetch response
  • KAFKA-7278 - replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments list