Pick your Streaming Engine
Hortonworks supports a number of powerful Streaming Engines including:
- Spark Streaming (Currently Supported in HDP)
- Streaming Analytics Manager (SAM) using Apache Storm (Currently Supported in HDF)
- Apache Kafka Streams (Will be supported in future HDP/HDF release)
Hortonworks provides you the flexibility to pick the streaming engine of your choice to build streaming analytics application.
If your organization has not standardized on a streaming engine and is looking for guidance on choosing an engine, use the below table to help guide your selection.
|Requirement||Streaming Engine to Use|
|You want to build streaming applications with as little code as possible and want to use ETL like Tooling with a drag and drop paradigm to build streaming apps||Streaming Analytics Manager (SAM) with Storm|
|You want the ability to build an app that you can deploy in batch and/or streaming mode||Spark Streaming|
|You plan to develop streaming applications using scala and java and want a clean easy to use API||Spark Streaming|
|You want the ability to execute SQL against the stream||
|You want process event one at a time (no microbatching)||Streaming Analytics Manager (SAM) with Storm|
The below sections walk you through implementing the streaming analytics requirements with these different tools/engines.