Role of Flink in CSA

Cloudera Streaming Analytics (CSA) offers real-time stream processing and streaming analytics powered by Apache Flink. Implementing Flink on the Cloudera Platform allows you to have Kafka, HBase, HDFS and Kudu connectors, logging and monitoring solutions with Runtime components, and also Cloudera Manager as your cluster and service managing application.

CSA provides a flexible streaming solution with low latency that can scale to large throughput and state. For streaming analytics, CSA fits into a complete streaming platform augmented by Apache Kafka, Schema Registry, Streams Messaging Manager in the Cloudera stack. CSA offers the needed connectors depending on the chosen sources and sinks. Cloudera Manager and Kafka Metrics Reporter are provided for monitoring these services, and log aggregation solutions are also available to make the process of streaming analytics more efficient. The following illustration shows the CSA architecture with the available source and sink connectors, monitoring and logging options.