Kafka Connect
Kafka Connect Overview
Setting up Kafka Connect
Using Kafka Connect
Configuring the Kafka Connect Role
Managing, Deploying and Monitoring Connectors
Writing Kafka data to Ozone with Kafka Connect
Writing data in an unsecured cluster
Writing data in a Kerberos and TLS/SSL enabled cluster
Using the AvroConverter
Enabling and configuring the AvroConverter
Configuring AvroConverter for Debezium connectors
Reading Debezium Avro records from Kafka
Configuring EOS for source connectors
Securing Kafka Connect
Kafka Connect to Kafka broker security
Configuring TLS/SSL encryption
Configuring Kerberos authentication
Kafka Connect REST API security
Authentication
Configuring TLS/SSL client authentication
Configuring SPNEGO authentication and trusted proxies
Authorization
Authorization model
Ranger integration
Kafka Connect connector configuration security
Kafka Connect Secrets Storage
Terms and concepts
Managing secrets using the REST API
Re-encrypting secrets
Configuring connector JAAS configuration and Kerberos principal overrides
Configuring a Nexus repository allow list
Single Message Transforms
Configuring an SMT chain
ConvertFromBytes
ConvertToBytes
Connectors
Installing connectors
Installing custom developed connectors
Installing FileStream connectors
Debezium Db2 Source
Debezium MySQL Source
Debezium Oracle Source
Debezium PostgreSQL Source
Debezium SQL Server Source
HTTP Source
JDBC Source
JMS Source
MQTT Source
SFTP Source
Stateless NiFi Source and Sink
Dataflow development best practices
General recommendations and criteria
Dataflow execution and scheduling
Merging considerations for sink connectors
Considerations for listen-type source connectors
Mapping of NiFi features
Kafka Connect worker assignment
Kafka Connect log files
Kafka Connect tasks
Developing a dataflow
Deploying a dataflow
Downloading and viewing predefined dataflows
Configuring flow.snapshot
Tutorial: developing and deploying a JDBC Source dataflow
Syslog TCP Source
Syslog UDP Source
ADLS Sink
Amazon S3 Sink
Configuration example
HDFS Sink
Configuration example for writing data to HDFS
Configuration example for writing data to Ozone FS
HDFS Stateless Sink
HTTP SInk
InfluxDB SInk
JDBC Sink
Kudu Sink
S3 Sink