Learn how to set up Streams Messaging Manager for monitoring and managing Kafka
Connect.
Cloudera recommends that you use Streams Messaging Manager (SMM) to manage and
monitor Kafka Connect. In order to do this, first you need to configure SMM so that it can
interact with Kafka Connect. Performing the following steps will enable the Connect view in
SMM, which allows you to interact with Kafka Connect through a UI interface. Performing
these steps will also enable you to use the SMM REST API to interact with Kafka Connect.
-
Select the Streams Messaging Manager service.
-
Go to Configuration.
-
Find and configure the following properties:
- Kafka Connect Host
Enter the hostname of the machine that the
Kafka Connect role is deployed on. If you have multiple instances of
the Kafka Connect role, you can choose to use any of them. Add a
single hostname, as configuring multiple hostnames for high
availability is currently not supported.
- Kafka Connect Port
Enter the port that the Kafka Connect role
is using. The value of this property has to match the port set in the
kafka.connect.rest.port
or
kafka.connect.secure.rest.port
Kafka property. If the Kafka
Connect role is not TLS/SSL enabled, use the port specified in
kafka.connect.rest.port
. If TLS/SSL is enabled for the Kafka
Connect role, use the port specified in
kafka.connect.secure.rest.port
.
- Kafka Connect Protocol
Set this to http
if
SSL/TLS is not enabled for the Kafka Connect role. Set it to https
if SSL/TLS is enabled for the Kafka Connect role.
-
Click Save.
-
Restart the service.
SMM is configured and is able to manage and interact with Kafka Connect.
Go to the SMM UI and access the Connect view from the left column.
Alternatively, use the SMM REST API to interact with Kafka Connect.