What's New in Apache Kafka

Kafka auditing using Atlas

An Atlas hook is now available in Kafka. Once it is set up and configured, the hook provides Atlas with a continuous feed of information about the Kafka service and its metadata. This enables you to manage, govern, and monitor Kafka metadata in Atlas.

For instructions on how to set up and configure the Atlas hook, see Configuring the Atlas hook in Kafka. For more information on how the hook works and how Kafka metadata is collected, see Kafka metadata collection.

Kafka metrics endpoints can be secured

TLS/SSL encryption as well as Basic Authentication can now be enabled for the HTTP endpoints of Kafka metrics.

TLS/SSL encryption can be enabled with the SSL Encryption For HTTP Metric Reporter property. However, this property does not take effect on its own, TLS/SSL must be enabled for the Kafka broker for this property to work.

Basic Authentication can be enabled with the Enable HTTP Metric Report Basic Authentication property. In addition to enabling Basic Authentication, you also need to set a username and password used for authentication. These can be configured with the HTTP Metric Report User and HTTP Metric Report Password properties respectively.

For more information regarding these properties, see Kafka Properties in Cloudera Runtime.