Streaming Violation Events into a Data Lake and Operational Data Store
About This Task
Another common requirement is to stream data into an operational data store like HBase to power real-time web applications as well as a data lake powered by HDFS for long term storage and batch ETL and analytics.
Steps
Drag the HBase sink to the canvas and connect it to the ViolationEvents Rule processor.
Configure the Hbase Sink using the following parameters.
Drag the HDFS sink to the canvas and connect it to the ViolationEvents Rule processor.
Configure HDFS as below.
Make sure you have permission to write into the directory you have configured for HDFS path.
