What's New in Apache Kafka

Writing data to Ozone FS with the HDFS Sink Connector is now possible

You can now use the Cloudera developed HDFS Sink Connector in Kafka Connect to write Kafka topics to the Ozone Filesystem (Ozone FS). For a simple example, see Configuration example for writing data to Ozone FS in the Kafka Connect documentation.

Kafka no longer uses non-FIPS compatible algorithms by default

Murmur3 hashing is introduced for the log cleaner when it builds offset maps. In addition, to the introduction of the new hashing algorithm, the default algorithm used is also changed to Murmur3. The previous default was MD5. If required, MD5 can still be used by adding cloudera.log.cleaner.hashing.algorithm=MD5 to the Kafka Broker Advanced Configuration Snippet (Safety Valve) for kafka.properties property in Cloudera Manager.

Kafka FIPS compliant cryptography

Kafka can now be configured to use FIPS compliant cryptography, through the use of FIPS 140-2 validated encryption modules, and with deployment on FIPS mode enabled RedHat Enterprise Linux (RHEL) and CentOS Operating Systems.

For more information, see Installing and Configuring CDP with FIPS.

Default Value Changes