Cloudera Docs

Configuring Kafka for use by EFM

To integrate Edge Flow Manager (EFM) with Apache Kafka, you need to create Kafka topics that receive the heartbeats and acknowledgements from MiNiFi agents.

You are using Apache Kafka 2.5 or above version. For more details about Kafka and streaming setup, see Stream Processing documentation.

  1. Create a Kafka topic for receiving heartbeats.
    For example, you create a Kafka topic called heartbeat.
  2. Create a Kafka topic for receiving acknowledgements.
    For example, you create a Kafka topic called ack.
  3. Optional. If you want to enable two-way TLS or authentication using SASL_SSL, configure specific Kafka server properties accordingly.
    For more details about enabling TLS, see https://docs.confluent.io/platform/current/security/security_tutorial.html.