ReadyFlow Overview: Kafka to Snowflake Streaming
ou can use the Kafka to Snowflake Streaming ReadyFlow to move your data from a Kafka topic to a Snowflake table.
This ReadyFlow consumes JSON, CSV or Avro data from a source Kafka topic and parses the schema by looking up the schema name in the Cloudera Schema Registry. You can filter events based on a user provided SQL query. The filtered events are then merged into CSV files, compressed into gzip format and written to the destination Snowflake DB table.
Kafka to Snowflake Streaming ReadyFlow details | |
---|---|
Source | Kafka Topic |
Source Format | JSON, CSV, Avro |
Destination | Snowflake DB |
Destination Format | Snowflake DB |