Spark Streaming
Information on how to create a Streaming Analytics Application with Spark Streaming is under development and will be available after the HDF 3.2.0 release is complete.
Getting Started with Streaming Analytics
Also available as:
- Building an End-to-End Stream Application
- Prepare Your Environment
- Creating a Dataflow Application
- Pick your Streaming Engine
- Creating a Streaming Analytics Application with SAM
- Creating a Stream Analytics Application with SAM
- Two Options for Creating the Streaming Analytics Applications
- Creating a Service Pool and Environment
- Creating Your First Application
- Creating and Configuring the Kafka Source Stream
- Connecting Components
- Joining Multiple Streams
- Filtering Events in a Stream using Rules
- Using Aggregate Functions over Windows
- Implementing Business Rules on the Stream
- Transforming Data using a Projection Processor
- Streaming Alerts to an Analytics Engine for Dashboarding
- Streaming Violation Events to an Analytics Engine for Descriptive Analytics
- Streaming Violation Events into a Data Lake and Operational Data Store
- Deploy a SAM Application
- Advanced: Performing Predictive Analytics on the Stream using SAM
- Logistical Regression Model
- Export the Model into SAM's Model Registry
- Enrichment and Normalization of Model Features
- Upload Custom Processors and UDFs for Enrichment and Normalization
- Scoring the Model in the Stream using a Streaming Split Join Pattern
- Streaming Split Join Pattern
- Score the Model Using the PMML Processor and Alert
- Creating Visualizations Using Superset
- SAM Test Mode
- Four Test Cases using SAM’s Test Mode
- Test Case 1: Testing Normal Event with No Violation Prediction
- Analyzing Test Case 1 Results
- Test Case 2: Testing Normal Event with Yes Violation Prediction
- Analyzing Test Case 2 Results
- Test Case 3: Testing Violation Event
- Analyzing Test Case 3 Results
- Test Case 4: Testing Multiple-Speeding-Events
- Analyzing Test Case 4 Results
- Running SAM Test Cases as Junit Tests in CI Pipelines
- Four Test Cases using SAM’s Test Mode
- Creating Custom Sources and Sinks
- Stream Operations
- Troubleshooting and Debugging a Stream Application
- Creating a Stream Analytics Application with SAM
- Spark Streaming
- Running the Stream Simulator
- Managing Kafka with Streams Messaging Manager