Compaction Settings
Review the following settings in the Advanced kafka-broker category, and modify as needed:
-
log.cleaner.dedupe.buffer.size
-
Specifies total memory used for log deduplication across all cleaner threads.
By default, 128 MB of buffer is allocated. You may want to review this and other
log.cleaner
configuration values, and adjust settings based on your use of compacted topics (__consumer_offsets
and other compacted topics). -
log.cleaner.io.buffer.size
-
Specifies the total memory used for log cleaner I/O buffers across all cleaner threads. By default, 512 KB of buffer is allocated. You may want to review this and other
log.cleaner
configuration values, and adjust settings based on your usage of compacted topics (__consumer_offsets
and other compacted topics).