Configuring Streams Messaging Manager for Kafka Connect

Learn how to set up Streams Messaging Manager for monitoring and managing Kafka Connect.

Cloudera recommends that you use Streams Messaging Manager (SMM) to manage and monitor Kafka Connect. In order to do this, first you need to configure SMM so that it can interact with Kafka Connect. Performing the following steps will enable the Connect view in SMM, which allows you to interact with Kafka Connect through a UI interface. Performing these steps will also enable you to use the SMM REST API to interact with Kafka Connect.

  1. Select the Streams Messaging Manager service.
  2. Go to Configuration.
  3. Find and configure the following properties:
    • Kafka Connect Host

      Enter the hostname of the machine that the Kafka Connect role is deployed on. If you have multiple instances of the Kafka Connect role, you can choose to use any of them. Add a single hostname, as configuring multiple hostnames for high availability is currently not supported.

    • Kafka Connect Port

      Enter the port that the Kafka Connect role is using. The value of this property has to match the port set in the kafka.connect.rest.port or kafka.connect.secure.rest.port Kafka property. If the Kafka Connect role is not TLS/SSL enabled, use the port specified in kafka.connect.rest.port. If TLS/SSL is enabled for the Kafka Connect role, use the port specified in kafka.connect.secure.rest.port.

    • Kafka Connect Protocol

      Set this to http if SSL/TLS is not enabled for the Kafka Connect role. Set it to https if SSL/TLS is enabled for the Kafka Connect role.

  4. Click Save.
  5. Restart the service.
SMM is configured and is able to manage and interact with Kafka Connect.
Go to the SMM UI and access the Connect view from the left column. Alternatively, use the SMM REST API to interact with Kafka Connect.