Cloudera Docs

Introduction to Kafka Connect

Learn how to use Kafka Connect to deploy connector implementations for common data sources and sink to move data to and from Kafka.

Kafka Connect is a framework for connecting Kafka with external systems. You can create the following types of connectors through Kafka Connect in Streams Messaging Manager (SMM):
  • Source Connector

    A source connector delivers data from external systems like databases to Kafka topics.

  • Sink Connector

    A sink connector delivers data from Kafka topics to external systems, for example, S3 and Hadoop.

You can use the Kafka Connect option in SMM to create connectors in your cluster, and read data from or write data to Kafka topics.