Cloudera Docs

Use KPIs to monitor whether flows in your deployment are processing data

Learn how to use KPIs to monitor whether the flows in your deployment are processing data.

You want to track how much data your flows are receiving from external systems or processing to an external system. It is a common use case where you might want to track whether your flows are reading or writing data as expected.
You can achieve your goal by selecting appropriate KPI scope and metric while deploying your flow in Cloudera Data Flow. Select All Flows KPI scope and Data In or Data Out metric to track. Select Data In metric to track how much data your flow is reading and Data Out metric to track how much data your flows are writing to the external system. In this example, Data In metric is selected. The Data In metric tracks rate of data received from an external source in bytes.
You must have reached the Add New KPI screen while deploying your flow in Cloudera Data Flow.
  1. Select All Flows as the KPI scope.
  2. Select Data In as the metric to track.
  3. Configure the alert settings as per your requirement or when you want to be alerted.
  4. Click Apply.
    Similarly, you can set other metrics and alerts as per your requirement.

In this example, you get an alert when your flow is receiving less than 2 MB data per second for 5 minutes.