Cloudera Docs

Kafka Connect Overview

Kafka Connect is a framework for connecting Kafka with external systems. You can use Kafka Connect to deploy connector implementations for common data sources and sinks to move data to and from Kafka.

You can create the following types of connectors through Kafka Connect in SMM:
  • Source Connector. A source connector delivers data from external systems like databases to Kafka topics.
  • Sink Connector. A sink connector delivers data from Kafka topics to external systems, for example, S3 and Hadoop.

You can use the Kafka Connect option in SMM to create connectors in your cluster, and read data from or write data to Kafka topics.