Streaming Data into HCP
To prepare for HCP to ingest data source data into HCP, you must stream each raw event stream from the telemetry data source into its own individual Kafka topic. This applies to the telemetry data sources for which HCP includes parsers (for example, Bro, Snort, and YAF). Even though HCP includes parsers for these data sources, HCP does not install these data sources or ingest the raw data. This is something that you must do.
- NiFi
-
This type of streaming method works for most types of data sources.
NoteEnsure that the NiFi web application is using port 8089.
- Performant network ingestion probes
-
This type of streaming method is ideal for streaming high volume packet data.
- Real-time and batch threat intelligence feed loaders
-
This type of streaming method is used for real-time and batch threat intelligence feed loadNiFiers.