Configuring Cloudera Observability for Cloudera Data Engineering

To monitor Cloudera Data Engineering (CDE) with Cloudera Observability, you must enable the observability analytics option in the telemetry section of your Cloudera Data Engineering service. This requirement applies to both new and existing services. After you enable this feature, you must run Spark jobs for the data to be displayed in Cloudera Observability.

New CDE service

  1. Log in to Cloudera Data Engineering UI.
  2. To add a new Cloudera Data Engineering service, see the Adding a Cloudera Data Engineering service documentation.
Step result: You must run Spark jobs from Cloudera Data Engineering for the data to be available in Cloudera Observability.

Existing CDE service

  1. Log in to Cloudera Data Engineering UI.
  2. In the existing Cloudera Data Engineering service, you must navigate to the Telemetry section and select the Enable Observability Analytics checkbox. For more information, see the Managing a Cloudera Data Engineering Service documentation.
Step result: You must run Spark jobs from Cloudera Data Engineering for the data to be available in Cloudera Observability.

For more information, see the Monitoring Cloudera Data Engineering with Cloudera Observability documentation.