ReadyFlow: Kafka to Kafka

Learn about the Kafka to Kafka ReadyFlow.

This ReadyFlow consumes data from a source Kafka topic and writes it to the specified destination topic. The flow does not apply any schema to the data. The data is simply passed through to the specified destination topic. Failed Kafka write operations are retried automatically to handle transient issues. Define a KPI on the failure_WriteToKafka connection to monitor failed write operations.

ReadyFlow details
Source Kafka topic
Source Format Any
Destination Kafka topic
Destination Format Any
Table 1. Kafka to Kafka ReadyFlow configuration parameters
Parameter Name Description
CDP Workload User Specify the CDP machine user or workload user name that you want to use to authenticate to Kafka. Ensure this user has the appropriate access rights to the source and destination Kafka topics.
CDP Workload User Password Specify the password of the CDP machine user or workload user you are using to authenticate against Kafka.
Kafka Broker Endpoint Specify the Kafka bootstrap servers string as a comma separated list.
Kafka Consumer Group ID Specify the ID for the consumer group used for the source topic you are consuming from.
Kafka Destination Topic Specify the destination topic name that you want to write to.
Kafka Producer ID Specify the id for the Kafka producer writing into the destination topic.
Kafka Source Topic Specify a topic name that you want to read from.