What's New in Apache Kafka
Learn about the new features of Kafka in Cloudera Runtime 7.1.6.
Rebase on Kafka 2.5.0
Kafka shipped with this version of Cloudera Runtime is based on Apache Kafka 2.5.0. For more information, see Apache Kafka Notable Changes for version 2.5.0, as well as the Apache Kafka Release Notes for version 2.5.0 in the upstream documentation.
Allowed Replica Time Lag default value change
The default value of the Allowed Replica Time Lag
replica.lag.time.max.ms) property is increased from 10 to 30
Detailed GC metrics are exported for brokers
kafka_jvm_gc_timeis added. In addition, run count and time metrics are added for a handful of specific collectors which are the following:
- G1 Young Generation
- G1 Old Generation
- Concurrent Mark Sweep (CMS)
- PS MarkSweep
- PS Scavenge
kafka_jvm_gc_<collector_name>_<runs/time>. For example
For a comprehensive list of available Kafka Broker metrics, see Kafka Broker Metrics in the Cloudera Manager Reference.
Kafka centric clusters with Ranger authorization
Long term audit logging in Ranger can now be enabled or disabled. If you do not need to store audit logs for more than 90 days, long term audit logging can be disabled. If this feature is disabled, Ranger does not require HDFS as a dependency. As a result, you can install and deploy a Kafka centric cluster, which has Kafka and Ranger but not HDFS. For more information, see Installing a Kafka centric cluster.