Cloudera Distribution of Apache Kafka Incompatible Changes and Limitations

This section describes incompatible changes and limitations:

Flume shipped with CDH 5.6 and higher can only send data to Kafka 2.0 and higher via unsecured transport.

Security additions to Kafka 2.0 are not supported by CDH.

Topic Blacklist Removed

The MirrorMaker Topic blacklist setting has been removed in Cloudera Distribution of Kafka 2.0 and higher.

Avoid Data Loss Option Removed

The Avoid Data Loss option from earlier releases has been removed in Kafka 2.0 in favor of automatically setting the following properties.

  1. Producer settings
    • acks=all
    • retries=max integer
    • max.block.ms=max long
  2. Consumer setting
    • auto.commit.enable=false
  3. MirrorMaker setting
    • abort.on.send.failute=true