CDH 6 includes Apache Kafka as part of the core package. The documentation includes improved contents for how to set up, install, and administer your Kafka ecosystem. For more information, see the Cloudera Enterprise 6.0.x Apache Kafka Guide. We look forward to your feedback on both the existing and new documentation.

Issues Fixed in CDK 1.2.0 Powered By Apache Kafka

  • KAFKA-1642 - [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost
  • KAFKA-1650 - avoid data loss when mirror maker shutdown uncleanly
  • KAFKA-1797 - add the serializer/deserializer api to the new java client -
  • KAFKA-1667 - topic-level configuration not validated
  • KAFKA-1815 - ServerShutdownTest fails in trunk
  • KAFKA-1861 - Publishing kafka-client:test in order to utilize the helper utils in TestUtils
  • KAFKA-1729 - Add constructor to javaapi to allow constructing explicitly versioned offset commit requests
  • KAFKA-1902 - fix MetricName so that Yammer reporter can work correctly
  • KAFKA-1890 - Fix bug preventing Mirror Maker from successful rebalance
  • KAFKA-1891 - MirrorMaker hides consumer exception - making troubleshooting challenging
  • KAFKA-1706 - Add a byte bounded blocking queue utility
  • KAFKA-1879 - Log warning when receiving produce requests with acks > 1
  • KAFKA-1876 - pom file for scala 2.11 should reference a specific version
  • KAFKA-1761 - num.partitions documented default is 1 while actual default is 2
  • KAFKA-1210 - Windows Bat files are not working properly
  • KAFKA-1864 - Revisit defaults for the internal offsets topic
  • KAFKA-1870 - Cannot commit with simpleConsumer on Zookeeper only with Java API
  • KAFKA-1868 - ConsoleConsumer shouldn't override dual.commit.enabled to false if not explicitly set
  • KAFKA-1841 - OffsetCommitRequest API - timestamp field is not versioned
  • KAFKA-1723 - make the metrics name in new producer more standard
  • KAFKA-1819 Cleaner gets confused about deleted and re-created topics
  • KAFKA-1851 - OffsetFetchRequest returns extra partitions when input only contains unknown partitions
  • KAFKA-1512 - Fixes for limit the maximum number of connections per ip address
  • KAFKA-1624 - bump up default scala version to 2.11.4 to compile with java 8
  • KAFKA-742 - Existing directories under the Kafka data directory without any data cause process to not start
  • KAFKA-1698 - Validator.ensureValid() only validates default config value
  • KAFKA-1799 - ProducerConfig.METRIC_REPORTER_CLASSES_CONFIG doesn't work
  • KAFKA-1743 - ConsumerConnector.commitOffsets in 0.8.2 is not backward compatible
  • KAFKA-1769 - javadoc should only include client facing packages
  • KAFKA-1481 - Stop using dashes AND underscores as separators in MBean names
  • KAFKA-1721 - Snappy compressor is not thread safe
  • KAFKA-1764 - ZookeeperConsumerConnector should not put multiple shutdown commands to the same data chunk queue
  • KAFKA-1733 - Producer.send will block indeterminately when broker is unavailable
  • KAFKA-1742 - ControllerContext removeTopic does not correctly update state
  • KAFKA-1738 - Partitions for topic not created after restart from forced shutdown
  • KAFKA-1647 - Replication offset checkpoints (high water marks) can be lost on hard kills and restarts
  • KAFKA-1732 - DumpLogSegments tool fails when path has a '.'