Using ReadyFlows

The ReadyFlow Gallery is where you can find out-of-box flow definitions. To use a ReadyFlow, add it to the Catalog and then use it to create a Flow Deployment.

Kafka to S3 Avro

Kafka to S3 Avro ReadyFlow Summary

This ReadyFlow consumes JSON, CSV or Avro data from a source Kafka topic and merges the events into Avro files before writing the data to S3. The flow writes out a file every time its size has either reached 100MB or five minutes have passed.

Ingesting Data using the Kafka to S3 Avro ReadyFlow

You can use the Kafka to S3 Avro ReadyFlow to move your data into an AWS bucket.

Kafka Filter to Kafka

Kafka Filter to Kafka ReadyFlow Summary

This ReadyFlow consumes JSON, CSV, or Avro data from a source Kafka topic and parses the schema by looking up the schema name in the CDP Schema Registry. You can filter events by specifying a SQL query in the Filter Rule parameter.

Ingesting Data using the Kafka Filter to Kafka ReadyFlow

You can use the Kafka Filter to Kafka ReadyFlow to move your data from a Kafka topic to another Kafka topic while applying a schema to the data in Cloudera DataFlow (CDF).

Kafka to Kafka

Kafka to Kafka ReadyFlow Summary

This ReadyFlow consumes JSON, CSV, or Avro data from a source Kafka topic and parses the schema by looking up the schema name in the CDP Schema Registry.

Ingesting Data using the Kafka to Kafka ReadyFlow

You can use the Kafka to Kafka ReadyFlow to move your data from a Kafka topic to another Kafka topic.

S3 to S3 Avro

S3 to S3 Avro ReadyFlow Summary

This ReadyFlow consumes JSON, CSV or Avro data from a source S3 bucket and transforms the data into Avro files before writing it to another S3 bucket.

Ingesting Data using the S3 to S3 Avro ReadyFlow

You can use the S3 to S3 Avro ReadyFlow to move your data between two AWS buckets, while transforming it to Avro format.

Kafka to Cloudera Operational Database

Kafka to Cloudera Operational Database ReadyFlow Summary

This ReadyFlow consumes JSON, CSV or Avro data from a source Kafka topic, parses the schema by looking up the schema name in the CDP Schema Registry and ingests it into an HBase table in COD.

Ingesting Data using the Kafka to Cloudera Operational Database ReadyFlow

You can use the Kafka to Cloudera Operational Database ReadyFlow to move data into Cloudera Operational Database through Cloudera DataFlow.

Kafka to Kudu

Kafka to Kudu ReadyFlow Summary

This ReadyFlow consumes JSON, CSV or Avro data from a source Kafka topic, parses the schema by looking up the schema name in the CDP Schema Registry and ingests it into a Kudu table.

Ingesting Data using the Kafka to Kudu ReadyFlow

You can use the Kafka to Kudu ReadyFlow to move your data from a Kafka topic into Apache Kudu in a CDP Public Cloud Real-time Data Mart cluster.

S3 to S3 Avro with S3 Notifications

S3 to S3 Avro with S3 Notifications ReadyFlow Summary

This ReadyFlow consumes JSON, CSV or Avro data from a source S3 bucket and transforms the data into Avro files before writing it to another S3 bucket. The ReadyFLow is configured with notifications about new files that arrive in the sourcce AWS bucket.

Ingesting Data using the S3 to S3 Avro with S3 Notifications ReadyFlow

You can use the S3 to S3 Avro ReadyFlow to move your data between two AWS buckets, while transforming it to Avro format. The ReadyFLow is configured with notifications about new files that arrive in the sourcce AWS bucket.