ReadyFlow overview: ListenHTTP filter to Kafka

You can use the ListenHTTP filter to Kafka ReadyFlow to listen to JSON, CSV or Avro events on a specified port and write them to Cloudera Kafka.

This ReadyFlow listens to a JSON, CSV or Avro data stream on a specified port and parses the schema by looking up the schema name in the Cloudera Schema Registry. You can filter events by specifying a SQL query in the 'Filter Rule' parameter. The filtered events are then converted to the specified output data format and written to the destination Cloudera Kafka topic. Failed Kafka write operations are retried automatically to handle transient issues. Define a KPI on the 'failure_WriteToKafka' connection to monitor failed write operations.

ListenHTTP filter to Kafka ReadyFlow details
Source	ListenHTTP Processor
Source Format	JSON, CSV, Avro
Destination	CDP Kafka Topic
Destination Format	JSON, CSV, Avro

Moving data with a ListenHTTP filter to Kafka flow

You can use a ListenHTTP filter to Kafka data flow when you want to stream records from a non-Cloudera source location to a Cloudera managed Kafka Topic.