ReadyFlow overview: ListenHTTP filter to Kafka

You can use the ListenHTTP filter to Kafka ReadyFlow to listen to JSON, CSV or Avro events on a specified port and write them to CDP Kafka.

This ReadyFlow listens to a JSON, CSV or Avro data stream on a specified port and parses the schema by looking up the schema name in the CDP Schema Registry. You can filter events by specifying a SQL query in the 'Filter Rule' parameter. The filtered events are then converted to the specified output data format and written to the destination CDP Kafka topic. Failed Kafka write operations are retried automatically to handle transient issues. Define a KPI on the 'failure_WriteToKafka' connection to monitor failed write operations.

ListenHTTP filter to Kafka ReadyFlow details
Source ListenHTTP Processor
Source Format JSON, CSV, Avro
Destination CDP Kafka Topic
Destination Format JSON, CSV, Avro

Moving data with a ListenHTTP filter to Kafka flow

You can use a ListenHTTP filter to Kafka data flow when you want to stream records from a non-CDP source location to a CDP managed Kafka Topic.