Apache Flink OverviewPDF version

Streaming Analytics in Cloudera

Cloudera Streaming Analytics offers real-time stream processing and streaming analytics powered by Apache Flink. Flink implemented on Cloudera provides a flexible streaming solution with low latency that can scale to large throughput and state. In addition to Flink, Cloudera Streaming Analytics includes Cloudera SQL Stream Builder to offer data analytical experience using SQL queries on your data streams.

Apache Flink
Cloudera Streaming Analytics is powered by Apache Flink that offers a framework for real-time stream processing and streaming analytics. Cloudera Streaming Analytics offers the features and functionalities of the upstream Apache Flink integrated on Cloudera Private Cloud.
Cloudera SQL Stream Builder
Cloudera SQL Stream Builder is a job management interface to compose and run Continuous Streaming SQL on streams using Apache Flink as an engine, as well as to create REST APIs for the results.
Cloudera Platform
Implementing Flink on Cloudera allows you to easily integrate with Cloudera Runtime components, and have all the advantages of cluster and service management with Cloudera Manager.
Streaming Platform
For streaming analytics, Cloudera Streaming Analytics fits into a complete streaming platform augmented by Apache Kafka, Schema Registry, Cloudera Streams Messaging Manager in the Cloudera Runtime stack.
Supported Connectors
Cloudera Streaming Analytics offers a set of connectors for Flink and Cloudera SQL Stream Builder from which you can choose from based on your requirements. Kafka, HBase, HDFS, Kudu and Hive connectors are available for Flink. Kafka, HDFS/S3, JDBC and a set of the Debezium CDC connectors are available for SSB. Other than the connectors, SSB also supports Schema Registry, Hive and Kudu as catalogs.
Monitoring Solutions
In Cloudera Private Cloud, Cloudera Streams Messaging components provide tools that support the operational needs of Cloudera Streaming Analytics. For example, when Kafka is used as a connector, you can use Kafka Metrics Reporter and Streams Messaging Manager for Kafka management and alerting of Kafka actions. Beside Streams Messaging Manager, you can use the Flink Dashboard to monitor your Flink and Cloudera SQL Stream Builder jobs.